← Back to context Comment by hartator 6 hours ago It's kind of interesting this is already out of data as it's missing Kimi 3 and Opus 5. 3 comments hartator Reply StefanKarpinski 1 hour ago Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things. pohl 1 hour ago Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku StefanKarpinski 1 hour ago They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
StefanKarpinski 1 hour ago Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.
pohl 1 hour ago Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku StefanKarpinski 1 hour ago They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
StefanKarpinski 1 hour ago They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.
Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku
They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)