Comment by root_axis
5 days ago
What's your point? Obviously, a secure server storing encrypted data on disk in a manner where it is only accessible through a secured API is not what is being discussed here.
5 days ago
What's your point? Obviously, a secure server storing encrypted data on disk in a manner where it is only accessible through a secured API is not what is being discussed here.
how do you think the LLM will do required operations when the secrets are stored somewhere other than the disk? It will still need to get them just like the application gets them when it has to do work.
> how do you think the LLM will do required operations when the secrets are stored somewhere other than the disk
Using a secret manager API? I'm not sure what you're getting at.
The LLM can use the secret manager API too, it sees how it's used in the application