Comment by simonw

Yeah, this is one of the most interesting challenges around model price comparisons.

This was hardly a consideration a year ago, when many model tasks could be tested using a single prompt and it was hard to spend more than a dollar.