Comment by pietz
15 hours ago
That's not being debated here. The initial reported numbers were false and this was simply pointed out. You're changing the subject.
15 hours ago
That's not being debated here. The initial reported numbers were false and this was simply pointed out. You're changing the subject.
Opus 5 medium has the same score as 3.8 flash on artificial analysis intelligence index.
Are you implying Google or Artificial Analysis are reporting false numbers? What's your source?
BTW you're comparing 3.8 flash high to opus 5 medium. 3.8 flash medium scores lower.
Flash models are on the order of 1/10th the size of Opus models, so some flex in the thinking level is fair.
4 replies →
> [...] shows an intelligence score of 59, the same as Opus 5 medium!
Nothing here is false, you are simply confused. You either didn't read what they wrote in its entirety or decided to reinterpret what they did write.
"Beating opus" is the false part, no?