Comment by tmnvix
2 hours ago
Haha, your analogy reminds me of one I often make to highlight just how much we undervalue fossil fuels.
Imagine filling your car with $1 worth of fuel and then driving it on flat terrain as far as it will take you. Now get out and push your car back. Friction and momentum aside, that's the astounding amount of energy/work we get from a dollar's worth of fuel.
Now imagine your car is actually an LLM model. It gets you a great distance on $1 worth of tokens but what happens when you run out and for whatever reason (I can imagine quite a few) further LLM use is not possible. You have to push your car/LLM back all by yourself to finish what was supposed to be a quick, convenient trip to the grocery store. Might've been better off walking.
Seriously though, I do think there is a real risk that LLMs are going to lure a lot of people far beyond their ability to swim back. It might even be the case that LLMs help strand people in situations that even the LLMs can't help rescue them from.
I agree with your point, I found it makes more sense with the company when they have a problematic product no one can fix.
I've gotten into a situation multiple times where an LLM (usually a low-end free model) will write a whole bunch of code and then be unable to make any more correct changes to it because it can't hold enough context. Super easy to get into a duplicative spaghetti mess - exactly like I've seen human developers do countless times, but even worse.