Comment by gustavus

> Models of 30B parameters and under can already complete many of the individual steps for replication today, though they make mistakes when composing them end to end.

I know theoretically how an internal combustion engine works so I can basically build a car

>A model that’s too large to fit on one device can be split into pieces, or shards, that run on separate machines that communicate with each other to collectively run the model.

The big labs but sure as hell how that isn't the case, because if we can do distributed computing to train and run AI efficiently then no one is stopping it anyway. Beyond that most home IoT devices will fall over and die if you look at them funny let alone trying to run a whole distributed LLM, not to mention plenty of home routers are going to give up and die of heat stroke before being able to approximate anything close to a reasonable LLM.

I stopped reading, this strikes me as the kind of people that assume because they read a book about something they'll be able to do it. The real problem a self replicating LLM vai IOT is going to run into is fighting the cyber criminals that have already compromised the device and using it as part of a botnet.