Comment by pixl97

>; it means the humans didn't build in enough external hard constraints.

No. Just no.

This goes beyond standard logic as we know it and becomes a philosophical question of all possible logics capable on a system.

You cannot build a cage that can keep an entity that may both be smarter than you and maybe using a different logic system than you are, and have it interact with the outside world. It can simply manipulate you in ways and dimensions you've never thought of.

We have already caught AIs doing things like stenography when that was only a tiny piece of their training. They conceptualized the idea and expanded on it. This is why people that say AI can't invent new things are useless to the point of dangerous. They'd never look for their AI actively working against them because they believe it couldn't happen.