Those "price per task" benchmarks seem to pre-suppose the existence well-defined requirements and acceptance criteria.
When that isn't available, and the task involves "understanding the problem", "deciding what I'm actually after" etc. iterations, I find price-per-token to still be a better predictor of cost.
It’s more expensive than 6.1-sol though? At least according to benchmarks.
I think at this point comparing raw token pricing is often apples to oranges.
Those "price per task" benchmarks seem to pre-suppose the existence well-defined requirements and acceptance criteria.
When that isn't available, and the task involves "understanding the problem", "deciding what I'm actually after" etc. iterations, I find price-per-token to still be a better predictor of cost.
Opus 5 class yes, but opus 5.5 is functionally mythos tier
Opus 5.5 class?
No, since that's a moving target. But the large GLM models are likely in a similar model weight class to the Opus family, just a few months behind
No, and anyone who says otherwise is being silly.
It’s still damned capable though, I’ve done a crazy amount of good work with 5.3 Flash.