Comment by fragmede
3 days ago
Google's own Gemma models are runnable locally on a Pixel 9 Max so some lev of AI is replicatable client side. As far as Gmail running locally, it wouldn't be impossible for Gmail to be locally hosted and hit a local cache which syncs with a server only periodically over IMAP/JMAP/whatever if Google actually wanted to do it.
Yes, but seems like a lot of hassle for not much gain (for Google).
The gain, as far as local AI goes for Google, is that, at Google scale, the CPU/GPU time to run even a small model like Gemma will add up across Gmail's millions of users. If clients have the hardware for it (which Pixel 9's have) it means Gmail's servers aren't burning CPU/GPU time on it.
As far as how Gmail's existing offline mode works, I don't know.
To make the discussion easier, we can look at the state of GMail before widespread AI was a thing.
(I have to use some weaselwording here, because GMail had decent spam detection since basically forever, and whether you call that AI or not depends on where we have shifted the goalposts at the moment.)