Comment by d4ng
7 hours ago
Why is on-device AI the future? What is your reasoning behind this? Look at the proportion of things we compute on someone else’s computer relative to what we compute on our own device. Why would this change for LLMs?
7 hours ago
Why is on-device AI the future? What is your reasoning behind this? Look at the proportion of things we compute on someone else’s computer relative to what we compute on our own device. Why would this change for LLMs?
I think the reasoning is similar to why Amazon notification emails are very generic: user data is used for various purposes that a growing number of users and 3rd parties have concerns about.
In addition to on-device, Apple is making efforts to secure computations that need to occur off-device, see: https://security.apple.com/documentation/private-cloud-compu...
I don’t think users (as in the general population) have a good track record of being judicious with how they share data. In the past with social media etc it was consistently the opposite, if the price is lower or free people tick any box and hand of all their personal data. Might turn out the same here too no?
Not arguing against on-device LLMs, I also wish it were so.