Comment by const_cast

This usecase is run of the mill for someone like Google, who used to store and show you your location forever, but it's not in Apple style.

It's hard to be like "uhhh privacy" when you send all requests to a remote server where they're stored in clear text for god knows how long.

As of right now, there is no way to run big LLMs in a privacy preserving manner. It just doesn't exist. You can't E2EE encrypt these services, because the compute is done on the server, so it has to decrypt it.

There are some services which will randomize your instance and things like that, but that kind of defeats the a big part of what makes LLMs useful, context. Until we can run these models locally, there's no way to get around the privacy nightmare aspects of it.