Comment by attemptone
6 days ago
>I feel the opposite, and pretty much every metric we have shows basically linear improvement of these models over time.
Wait, what kind of metric are you talking about? When I did my masters in 2023 SOTA models where trying to push the boundaries by minuscule amounts. And sometimes blatantly changing the way they measure "success" to beat the previous SOTA
Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case
We were talking about linear improvements and I have yet to see it
check the benchmarks or make one of your own
2 replies →