Comment by LoganDark
7 days ago
I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
7 days ago
I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.
When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.