Comment by x______________

> A model that’s too large to fit on one device can be split into pieces, or shards, that run on separate machines that communicate with each other to collectively run the model. Machines that could run a significant model shard for a <30B model include smart fridges, smart ovens, automatic vacuum cleaners, and lawnmowers.

Seems like they've inadvertent exposed the industry of hardware limitations, allowing local llms to exist at home without the latest 5090 or its equivalent.

On the other hand, a non-corp controlled oracle-esque llm running on the IoT would be interesting: it could automatically patch every device, kick everyone out and exist. Now if would only remain as an oracle living in the internet and not gain consciousness and a will of its own..