Comment by devin
2 months ago
And then you realize that what you’re using the smaller models for is ALSO decomposable and part of it is just a few if statements, and then you realize that for this feature you don’t actually need or want a model because the performance, reliability, reproducibility are cheaper and better for you and your users.
So you have the model write the if statements and put itself out of a job.
Alternatively, and sometimes more cost-efficient: you can find a developer who can write bespoke if statements. There are dozens of us!
So, are we going to end up with a mechanical Turk that pretends it is an LLM but just farms out tasks to gig workers?
Additionally, developers tend to become less expensive as venture capitalists turn off the spigot, while access to giant frontier models becomes way more expensive. Beyond that, a developer might go out and have a beer with you after work, which appeals to the sickos that have the gall to prioritize humanity over fanatical efficiency for corporate gains.