Comment by jerojero
2 months ago
I really hope Apple is working hard on improving on-device models for their use case so they can get out of this.
2 months ago
I really hope Apple is working hard on improving on-device models for their use case so they can get out of this.
Companies working hard to bring us closer to on-device models are Kingston, Hynix, Micron and the like, not Apple. If they succeed, we will get on-device LLMs sooner. If not, well, it may take a while.
On device models are already so good. It's so insane Siri doesn't just use them.
Or why HomePods don't get answers via iPhone.
When I first read the headline, I thought they’d licensed a customized Gemma 3n for an on-device model.