Comment by lechatonnoir
5 days ago
One question is whether, even after all that backpedaling, you feel you could've achieved the same or a similar result in those five days. My findings have been that it's a net plus for productivity, but I'm a bit less sure whether I prefer the way work feels when a lot of it is just going back and cleaning up after the growth. (Of course, that sounds like a familiar statement for a lot of engineers before LLMs, too.)
This is why agents suck.
Backpedling is a massive inefficiency.
A better way is the single clean step approach.
Use the largest LLM you can. Have it generate a single output for one update.
If that update has logical errors or dropped anything you asked for restart, refine, narrow until it does.
It's quite hard to plan each step right but the level and conplexity you can get to is far higher than an agent.
Agents are much better at the shallow/broad problems.
Large LLMs are exponentially better deep/narrow problems.