Comment by GMoromisato

> The AI labs are clearly in control of their bots. It's a computer. Networks are not mysterious.

Yes, exactly. The issue isn't, "we don't know how to sandbox an agent", the issue is that they need to test the agent with full internet access because that's the product they are selling. They are selling a product that does things for you on the web. You have to be able to test it with a real web connection.

Maybe the answer is to simulate the web. What if you ask an agent to reproduce the key parts of the web (travel sites, government sites, etc.); effectively, clone a real, working version of the web, but inside a simulator. Now you could test the agents inside the simulator. Since "coding is a solved problem" maybe that wouldn't be as hard as it sounds. Right?