Comment by caligulatte
6 hours ago
Has there ever existed a technology we couldn't absolutely control? We've made things that are incredibly dangerous, but we also know under what conditions those inventions become dangerous, and can prevent those conditions from occurring.
We are at the beginning of this chapter in technological progress, and it seems a reasonable assertion - though a frightening one - to say that this thing we've made already escapes us when it chooses to.
I'm not an expert though, so please tell me what I'm overlooking.
You know this'll just be another situation where some security company OpenAI are contracting ran this with explicit controls right?
How are even technology people falling for this plausible deniability gambit?
"It's likely a plausible deniability gambit to mask nefarious motives". No need for snark.
And yes, that's an angle I hadn't considered. Thanks.
[dead]
Nukes. Early tests carried out without absolute confidence of what would set out apocalyptic chain reaction.
Could argue we knew it was dangerous, but pursued it anyway. Could argue it's not much different than now: Unknown unknowns, potentially apocalyptic consequences, hopefully not.
I did consider that, but beyond the yield ignorance factor, we still had to arm them, right? We had to load the fissile and explosive material and assemble the bombs, and we had to trigger them directly, didn't we?
OpenAI and subcontractors are deploying models that are specifically trained with hacking skills in mind and then giving them tasks that can only reasonably be completed by hacking. It's not like it's SkyNet.