Comment by ajross

> 2. Making critical systems available on internet to leverage integration with LLMs [...] which were otherwise in DMZ (demilitarized zone)

Honestly, I think this is actually not nearly paranoid enough. Phrased the way you do, it sounds like it's just a matter of setting boundaries in the right places and identifying "critical systems". But that's way, way harder than you'd think.

Here's my For Dummies reasoning behind the AI apocalypse:

1. AI is now at parity with median human reasoning capability and can use people's computing devices as well as the people can.

2. People commonly let AI operate their computers, and can be easily fooled into doing so in any case.

3. Society runs on computing devices operated by people.

4. There is no step four.

Basically any world where there is common access to AI agents (or whatever they end up being called) is one those agents can pretty trivially hijack.

If there is a protection regime that can prevent this, it's not about where the AI runs or what the boundary of its DMZ is.