Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.
I assume OP interpreted it as encryption that hides the prompts from OpenAI rather than OpenAI hiding information from users.
I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.
1 reply →
ooooooof yeah totally misinterpreted it lmao
Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.
Given what we know about the company, I find it crazy anyone would misinterpret along those lines lol.
1 reply →
to be fair, the title is very misleading, it took me a minute to understand what they meant