Comment by kelseyfrog

While reading AI Engineering[1], I was inspired to take a crack at an idea I've had for a while - diffusion-based LLM. The accessibility of shakespeare.txt[2] and the proliferation of tinyGPT implementations has made vibe-coding LLM research on the brink of possibility. It does help to have a familiarity in the datascience/ML/AI space in order to check and guide appropriately, but it's amazing how well the virtuous cycle is beginning to work.

1. https://www.oreilly.com/library/view/ai-engineering/97810981...

2. https://gist.github.com/blakesanie/dde3a2b7e698f52f389532b4b...