Run the same prompt on old models and the current "SOTA" and you'll get pretty much the same answer word for word.
People think models have improved because tooling around the models (Claude Code, Cline, or your other favorite LLM wrapper) has improved, not because the models themselves have made any kind of leap.
LLMs have hit the wall since ChatGPT came out in 2022?
Yes?
Run the same prompt on old models and the current "SOTA" and you'll get pretty much the same answer word for word.
People think models have improved because tooling around the models (Claude Code, Cline, or your other favorite LLM wrapper) has improved, not because the models themselves have made any kind of leap.
Big time.
I'm not a true believer, but even I wouldn't say they have hit a wall.
What makes you say that?
2 replies →