Comment by harrisi
12 hours ago
I genuinely don't know how any of these companies can make extreme profit for this reason. If a company makes a significantly better model, shouldn't it be able to explain how it's better to any competitor?
Google succeeded because it understood the web better than its competitors. I don't see how any of the players in this space could be so much better that they could take over the market. It seems like these companies will create commodities, which can be profitable, but also incredibly risky for early investors and don't make the profits that would be necessary to justify the evaluations of today.
> If a company makes a significantly better model, shouldn't it be able to explain how it's better to any competitor?
No. Not if it's not trained on any materials that reveal the secret sauce on why it's better.
LLM's don't possess introspection into their own training process or architecture.
That's my point. Anything that could exist that's significantly "better" would be able to share more about its creation. And anything that could be significantly better would have to be capable of "understanding" things it wasn't trained on.
That's not true. There are a million ways to be "significantly better" that don't involve knowledge about the model's creation. It can be 10x or 100x or 1000x more accurate at coding, for example, without knowing a single thing more about its own internal training methodology.