← Back to context

Comment by TedDoesntTalk

6 days ago

Can’t they physically air gap the frontier model training environment? I don’t see that mentioned in the post, but I didn’t read all of it.

If not, why?

I don't see how that's possible given they're likely training on multiple data centers' worth of GPUs scattered around the world. So you still need to get updated training data, software upgrades and everything else onto those machines. And then get the finished product out. And with iteration speeds in AI it likely needs to happen on a daily basis or multiple times a day.

  • > training on multiple data centers' worth of GPUs scattered around the world

    ...so stop scattering things across many data centers.

    > iteration speeds

    Which can be slowed down for the sake of not breaking the law.

    > it likely needs to happen on a daily basis or multiple times a day.

    Keep it inside the airgap until you are ready to move the model into production. What's the problem here?

“Completely air-gapping this infrastructure—that is, disconnecting it entirely from external networks—isn’t currently feasible, since we need external connections in order to run and monitor experiments”

  • No they don't, the control and monitor system could be inside the air-gapped isolated environment but then it is not "convenient".