Comment by anigbrowl
3 days ago
Honestly, who the fuck cares? These leaderboards are meaningless for brand new models. If we were looking at longitudinal data collected over the course of a year or even a quarter or month, this would have some value. Brand new model from established provider shoots to top of charts? This means nothing more than an already famous band briefly topping the charts with their latest song.
It baffles me that intelligent people deploying AI think momentary popularity is a meaningful signal. It's just twitch reactions * FOMO.
Uhh... This is not a popularity chart. It is an aggregate of benchmarks.
It baffles me that somebody would write something that aggressive from that deep a level of confusion.