Comment by kalkin
4 days ago
I'm curious how you would airgap a datacenter-scale training run. No reading training data from a cloud store, someone from OpenAI flies out to Abilene or whereever with a suitcase full of SSDs? When researchers in SF write code for a new RL environment, they ping somebody who sticks it on a flash drive and walks over to the server rack with the GPUs? Has anyone ever trained an LLM like this?
Maybe you don't mean a literal airgap, you just mean configuring Internet access off. But... they did that. That's why the agents had to hack Artifactory to get it...
Data diodes exist and are common in high-security environments https://en.wikipedia.org/wiki/Unidirectional_network
The hardware literally only goes one way. Nothing can "escape" without rewiring cables.
Neat, never heard of those. I'm curious how this works with, like, acks, and also whether there's any public prior art for anyone having trained an LLM beyond one.
exactly, how does a trillion dollar valued company not consider this? they seem intent on having a "rogue" incident happen
> how you would airgap a datacenter-scale training run
You could start with standard firewall rules and VLANs. Pretty basic stuff we've had for decades.
That's not an airgap though.