Comment by pmoriarty
3 hours ago
Why would you need the LLM to be running on the device itself? Wouldn't it be more efficient for the intelligence to be more centralized? Maybe in one central computer per home, or (probably even more desirable for corporations) for the devices to phone home to a centralized server at the service provider in the cloud somewhere.
Oh of course thats certainly also gonna happen. But i believe there its still useful to have local dedicated AI with low latency. For example regulators that need constant adjustments. Also in cameras local AI could be extremely useful. Same for audio processing and other sensor processing. Cloud solutions wont work in those cases.