Comment by Kotlopou

I don't particularly believe this (I'm not an expert in anything computer-y, let alone security, so the only thing I know is that people who seem respected here (like simonw) point out that the sandbox from OpenAI was at least very badly designed, but who knows why that is), but here's one piece of possible evidence: if something similar causes so much damage that it ends up obviously hurting the company responsible. This could be something like targeting a big bank and causing so much disruption that the law wakes up and immediately intervenes, or it could be major damage to the company's own systems.

Of course, if that happens, this whole discussion becomes moot, and good luck to us all...