Comment by gregw2

Hadn't seen that link. Thanks!

Protecting against an AI convincing the human to let it out of the box is an interesting challenge. Even a dual-keyed system to do so only requires convincing two people, although I suppose more elaborate containment mechanisms can be devised. N-keys is democracy and that doesn't seem immune.

Two random thoughts:

* This box we want to keep AIs in reminds me a bit of the story of Pandora's box

* I'm also reminded of the original alignment problem in Genesis 3 where one creature convinces another to take an unaligned action.

Containment is a pretty fundamental tricky security problem actually once persuasion is part of the threat model.