Comment by madaxe_again
10 days ago
Not even remotely. In LLM land, the progress seems slow the past few years, but a lot has happened under the hood.
Elsewhere in AI however progress has been enormous, and many projects are only now reaching the point where they are starting to have valuable outputs. Take video gen for instance - it simply did not exist outside of research labs a few years ago, and now it’s getting to the point where it’s actually useful - and that’s just a very visible example, never mind the models being applied to everything from plasma physics to kidney disease.
> the progress seems slow the past few years, but a lot has happened under the hood.
The claim is "exponential" progress, exponential progress never seems "slow" after it has started to become visible.
I've worked in the research part of this space, there's neat stuff happening, but we are very clearly in the diminishing returns phase of development.
We continue to see steady progress, look at any benchmark and its basically a linear increase.