Comment by hartator 7 hours ago It's kind of interesting this is already out of data as it's missing Kimi 3 and Opus 5. 3 comments hartator Reply StefanKarpinski 2 hours ago Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things. pohl 2 hours ago Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku StefanKarpinski 2 hours ago They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
StefanKarpinski 2 hours ago Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.
pohl 2 hours ago Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku StefanKarpinski 2 hours ago They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
StefanKarpinski 2 hours ago They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.
Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku
They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)