Comment by tempay
7 days ago
I assume OP interpreted it as encryption that hides the prompts from OpenAI rather than OpenAI hiding information from users.
7 days ago
I assume OP interpreted it as encryption that hides the prompts from OpenAI rather than OpenAI hiding information from users.
I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.
When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.
ooooooof yeah totally misinterpreted it lmao
Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.
Given what we know about the company, I find it crazy anyone would misinterpret along those lines lol.
I can only say I am a little too optimistic about the technology world in general. Or at least would love to see some good news once in a while given the state of the world.
to be fair, the title is very misleading, it took me a minute to understand what they meant