Comment by cogman10
5 hours ago
> the incentive to change them is incredibly low
There is no incentive to rewrite working software in COBOL to something else. You don't really change the people cost of maintaining that code all that much and you incur a huge rewrite cost.
AI is different, it's an ongoing cost to the company. If that cost raises aggressively, you can bet companies will race to eliminate it, no matter how integrated it is. Companies can and do do this all the time.
And the models are close, not the same, but close. That's what matters in LLM stuff in general. If a model is capable of doing the same work for less, it will be chosen. Especially since the switch over cost is often on the level of "point the tool at this URL instead of that URL".
I get what you are saying if this were a more sticky concrete tech that is harder to move away from. But that's simply not the case for these LLMs. A big selling point they have is that they are super flexible.
We might need to agree to disagree on this one.
I don't think the transition will be as simple as just flipping a URL. There is an entire legal and technical infrastructure being built around these models and their integration. I think you underestimate an organization's resistance to change once things actually work, as well as the sheer complexity of making that shift.
I also expect pressure will eventually drive the cost of running these models down. Power plants are being built, more capable chips are being produced, and a big chunk of the capital right now is being used to scale the physical infrastructure—the data centers and energy grid. Once that stabilizes, these companies will have positive cash flows. Again, it's highly similar to what we saw with the expansion of social networks, just with more aggressive and widespread adoption.
Ultimately, a handful of companies are going to provide these core capabilities, just like we have a handful of major cloud providers right now. Why do you think this would change? If anything, the trend toward deep vendor lock-in is even stronger now.