Comment by nrmitchi
2 days ago
You can have large scale airgapped environments.
They don’t even need to be fully airgapped from each other (and is not what I’m suggesting).
But there should be no physical (physical layer; wireless counts) to the internet.
Can models detect they are airgapped and change their behaviors?
How much of the internet do you have to simulate to know if the model knows it's in training?
If you (in this case, OpenAI) can’t find a way to answer this question to a reasonable degree of accuracy without falling back to “yolo let’s see what happens” you are in no position to be doing this research.
Regardless, they (reportedly) _attempted_ to prevent internet access. They just didn’t in a way which can be escaped via software.
Yes, side channel exploits exist in airgapped environments to. But if a model found a way to escape an airgapped environment via non-networked side channel attacks then the correct answer is frankly “shut it down immediately and then thermite any machine it touched”
Ain't nobody with a trillion dollars invest gonna turn this crap off. Instead they'll sell the service to the government as a weapon.
1 reply →