Comment by nozzlegear

> Explain how you square this with leaderboards showing models are clearly improving in ELO

If I had to guess, the benches aren't measuring what people care about. But you'll have to ask the people in those Reddit threads why their vibes don't match up with your benches, I don't use Claude and don't give a shit.