Comment by switchbak
13 hours ago
“ Defense is hard so we should expect agents to be able to break out of sandboxes.”
I worked at a large networking company a few decades ago. Our “sandbox” was far superior to anything I’ve seen at these companies. What are we even talking about here? Why do they even have open routing to the broad internet? With no monitoring/alerting? These just sound like token efforts at this stage.
In this case, they needed routing to the internet because they needed to search and read from the internet.
Yeah. Unfortunately a model that only knows how to use a language's standard library isn't that useful. I am not sure why they had a pull-through cache instead of just asking Microsoft (their biggest investor) for a local copy of NPM or something, but ... they did. I think people thought you couldn't route to the Internet through Aritfactory and were proven wrong by a clever bug-finding model. So it goes.
I don't think their safety measures were the best, but "just sink the cluster to the bottom of the ocean so nothing can get out" isn't a training methodology that results in a model that people will want to use.