Comment by danny_codes
4 months ago
This seems like a wildly unlikely risk. Innovations in this space are just mathematical ideas, easy to write down in a paper and replicate.
It’s much more likely that performance will plateau and open weights will catch up asymptotically
Mathematical ideas are very difficult to protect. But models can also be improved with brute force improvements in size. Imagine Mythos is a 32 trillion parameter model for example. That could be very difficult to replicate even though everybody knows exactly how it works.
> It’s much more likely that performance will plateau and open weights will catch up asymptotically
I really don't think so. This almost never structurally happens.
I think it'll be more like Linux on the Desktop.
Or Ubuntu on the smartphone.
Or Firefox.
We'll have open weights, but 99% of everything will go through hyperscalers.
> I really don't think so. This almost never structurally happens. > I think it'll be more like Linux on the Desktop.
I think it will be Linux on the server, or the one that runs your watch, your phone, the radio or infotainment system in your car, maybe your thermostat, a bunch of medical devices and military devices, running in space shuttles and space stations and... You get the point. It's on everything.
The smartphone is the most important piece of infrastructure in the modern world, yet we have basically two vendors.
Unless something dramatically changes, that's the world we're in for.
Chinese foundation model providers are releasing fewer weights as they "catch up", not more. There's little incentive for anyone to dump on the market if they can't collect the proceeds.
2 replies →