Comment by melenaboija
1 day ago
The US business model for commercializing LLMs seems unsustainable to me. We are saying that they are creating trillions of dollars in value out of:
1. A model that for the most part is public and available to anyone. 2. A situation where the model’s success mostly comes from throwing as much data and computational resources at it as possible.
It seems that either of those assumptions could crumble quickly and unexpectedly. What if the AI paradigm changes completely and we no longer need GPUs? Or what if someone with enough determination decides to create a better model and sell it more cheaply, or free?
I don't know man, this looks scary to me.
There's already cases where Google and I'd assume others are designing chips to work with specific models more efficiently in coordination... Personally, I could even see more specialty models called/coordinated from the larger models that can do smaller pieces of targeted work very well within limited scopes as a mixed economy so to speak.
Assembling a new model from scratch requires a ton of resources and knowledge bases... there's been a lot of sketchy activity just in training. You also have weighting, distillation and other approaches to create more portable options that can run on lesser hardware. But, K3 as an example takes massive compute resources to run.. and this isn't going to get to a portable device any time soon... as Moore's law is effectively dead, you may get newer/better tooling around the LLMs, or you may get an entirely new/unique approach to AI... but current trends aren't going to put a leading model on your own hardware anytime soon for most people.