Comment by killingtime74
2 hours ago
You can't just look at the per token cost, but how many tokens it takes on average to do a task. The difference can be massive.
2 hours ago
You can't just look at the per token cost, but how many tokens it takes on average to do a task. The difference can be massive.
Also cache write/read cost + cache efficiency.
True, but it would have to be more than massive (order(s) of magnitude) to offset that gap.
We notice with frontier models like Astra and Fable that one might use a lot less tokens than the other to complete the task thereby being the better deal in spite of the far higher token cost.