Comment by selcuka
14 hours ago
> Micromanaging the model doesn't seem like a great idea when doing real professional work with professional goals/deadlines/pressures.
Remember that it's not only the cost per token, but also speed. Some tasks are done faster with simpler/less-thinking models, so it might actually make sense to micromanage the model when you have deadlines.
If you're using the models to generate 99%-100% of the code, then it doesn't make sense to plug yourself into the loop as a bottleneck.