Comment by xyzzy_plugh

I tend to agree with this perspective however I'd like to point out that using token quantity and cost as a measure of productivity is counter-intuitive. The variance for a given task can be extremely high regardless of the input, not to say that there isn't any skill to prompting or that talent doesn't matter.

Ultimately it feels pretty similar to using lines of code as a measure.

Instead I recommend setting a budget per head and evaluating performance traditionally, allowing for exceptions in exceptional circumstances of course.