Comment by randallsquared
2 days ago
Do you think there is such a thing as perfect security? No one can "get it right" in the face of arbitrarily high intelligence, which is why it would be preferable to get alignment correct before building something with higher intelligence than current sota. That, however, is not going to happen, because someone will take the risk even if "we" don't, and better "us" than them. Hence "If anyone builds it...".
> Do you think there is such a thing as perfect security? No one can "get it right" in the face of arbitrarily high intelligence
Why didn't they run the model against the sandbox first? They have effectively unlimited spend.
That's the alarming thing about this result: they did run the model in the sandbox, in the sense that they believed there was no internet access for the model.
“Against the sandbox” and “on the sandbox” are not the same thing.
1 reply →