Comment by rcyeh
3 days ago
Thanks for sharing!
A year or eighteen months ago, if you were to ask me how much I would personally pay to have access to a then-frontier model for work, I would have said: not much. They were frustrating to instruct and use. The cost of play was too high.
Six months ago, I think I would have paid $100 per month.
Today, for a current frontier model and harness with all-I-can-eat, I think I would pay a big chunk of my salary. Easily more than $2,000 per month.
Everything improved: models, harnesses, and instructions from me.
This makes me realize that I have no advantage over LLMs in general software development.
Think of using an LLM like driving a car. Easy enough, yeah? Do you say the car drove you to the airport or your friend the driver did? Let's watch four time World Champion Max Verstappen absolutely tear up 100 amateur go-kart drivers, courtesy of Red Bull: https://youtu.be/7GIULwETan4
LLMs are better than they first were when ChatGPT hit the scene in 2022, and you're not the Max Verstappen of LLM prompting or software development (it's okay, neither am I). But it's still food for thought, at least while their true capabilities are being held back by their progenitors and we're forced to ration their use.