Comment by qnleigh
2 days ago
I see. It'll be interesting to see how much on-device models take off for consumers, when off-device models will be so much more capable. In the past, the average consumer has typically been happy to trade privacy for better products, but maybe it will be different for llms.
Agreed. I think the latency wins could be meaningful for many of the obvious phone-centric usecases (Siri, app-/browser-enrichment, etc.) but the capability gap is definitely a hindrance.
Privacy is already a key differentiating feature for iPhone which is why I think they will continue to try to make this option viable. (They already do ChatGPT fallback which is a pragmatic concession to the reality that you highlight here.)