← Back to context

Comment by wasfgwp

15 days ago

It’s more expensive than 6.1-sol though? At least according to benchmarks.

I think at this point comparing raw token pricing is often apples to oranges.

Those "price per task" benchmarks seem to pre-suppose the existence well-defined requirements and acceptance criteria.

When that isn't available, and the task involves "understanding the problem", "deciding what I'm actually after" etc. iterations, I find price-per-token to still be a better predictor of cost.