Comment by PunchTornado
3 days ago
what? nobody looks at those benchmarks, you use whatever works for your task, in most cases either gemini or claude. those benchmarks don't mean anything as models overfit on them.
3 days ago
what? nobody looks at those benchmarks, you use whatever works for your task, in most cases either gemini or claude. those benchmarks don't mean anything as models overfit on them.
Come on, the benchmarks do mean something, even if companies overfit them. Models are indisputably improving together with their benchmark scores.