Comment by SV_BubbleTime

> sandbox was a paper bag

The exploit:

> The ExploitGym evaluation environment did not provide the models with direct Internet access. To gain Internet access, the models identified and exploited a previously unknown zero-day vulnerability in Artifactory, a package registry cache proxy. We disclosed this vulnerability, along with other Artifactory vulnerabilities our models identified as part of our review, to the vendor. [1]

Are most sandboxes more secure than only having a single avenue for internet access, the commercial package registry cache proxy, where the latter had a previously unknown zero-day vulnerability?

[1] https://openai.com/index/hugging-face-model-evaluation-secur...

OpenAI, Google, Anthropic, and Moonshot.ai have all "had this happen" now.

So, either they're all liars, or incompetent and negligent (and still liars).