Comment by sigmoid10
5 hours ago
It has already become irrelevant to anyone paying attention. Raw scores at published benchmarks mean next to nothing in modern use. They are either gamed to hell or unsolved to the point where differences can be explained by randomness. Speed, cost per token, tokens per task and hallucination levels are the useful axes you can compare along these days if you're not doing scientific frontier level research.
No comments yet
Contribute on Hacker News ↗