Comment by nl

As it happens...

I built E2E encrypted LLMs using secure enclaves, so I know a bit about this space.

The tech works, for small LLMs - the sort of thing you can run on your mobile already. It isn't yet (?) there for LLMs the size of ChatGPT.