Comment by shaky-carrousel

1 day ago

It's pretty impressive how thoroughly incompetent is OpenAI designing secure systems. But surely this is circumscribed to agent security. In no way are all my chat logs in some Russian forum.

BRB, I'm going to delete something before it also ends in Chinese forums.

Pretty much everything that has come out of OpenAI indicates that they have brilliant AI researchers, rather good developers and that they are... optimistic, about their abilities in operation and operational security. Apparently their own AI tools also aren't able to help them in that area. It's rather weird that entirely predictable incidents keep appearing, at least if your reaction is "Why was the agent even able to do that?".

I know it became a bit of a joke that Sam Altman wanted to ask their AI how to make a profit, but it doesn't seem that far fetch to ask it to help improve operations, at least in the future.