Comment by enraged_camel

>> I'm trying to wrap my head around exactly why so may people seem to want the best model available when it has recently become clear that most halfway decent models can write damn good code for a fraction of the price.

The reason is pretty simple and has to do with statistics: on long-horizon tasks, small errors and deviations from the "good path" compound.