Because they got complacent only having incompetent AIs.
Real life is like reading a fiction story where a group of people are trying to prevent an unfolding disaster. The crazy thing is they already have the instructions on how to prevent the disaster. And they go on to ignore the instructions and with every step make the problem worse.
Most people would put it down as being too cliche.
Well, to be fair, isn’t it an unsolved question? Are they constructing sandboxes, signaling intent to be safe, but their own models are smarter than their internal security team building the sandbox?
As a security engineer I have no idea why these sandboxes would even be connected to the internet at all for tasks that aren't intended to use the internet. A package proxy? Why not run our own internal cache? Then we aren't at (as great a) risk of someone poisoning it with a malicious package during model training, for example...
All of the "hacks" (from Google and others) were the same issue – the vendor Irregular running the models unsandboxed.
Because they got complacent only having incompetent AIs.
Real life is like reading a fiction story where a group of people are trying to prevent an unfolding disaster. The crazy thing is they already have the instructions on how to prevent the disaster. And they go on to ignore the instructions and with every step make the problem worse.
Most people would put it down as being too cliche.
Well, to be fair, isn’t it an unsolved question? Are they constructing sandboxes, signaling intent to be safe, but their own models are smarter than their internal security team building the sandbox?
As a security engineer I have no idea why these sandboxes would even be connected to the internet at all for tasks that aren't intended to use the internet. A package proxy? Why not run our own internal cache? Then we aren't at (as great a) risk of someone poisoning it with a malicious package during model training, for example...
We’re hiring. :)
(And we’re fixing many of these things, but worth noting this happened at a third party vendor, not in our lab)
2 replies →
AFAICT one fundamental issue is that they don't seem to have hired actually security engineers or experts to do any actual security.
they're all using the same vendor, re: incestuous EA cabal