Comment by killingtime74
1 hour ago
You can't just look at the per token cost, but how many tokens it takes on average to do a task. The difference can be massive.
1 hour ago
You can't just look at the per token cost, but how many tokens it takes on average to do a task. The difference can be massive.
Also cache write/read cost + cache efficiency.
True, but it would have to be more than massive (order(s) of magnitude) to offset that gap.