Comment by gr_norm

2 months ago

They've been saying so from the beginning, and yet did not take the basic precaution of airgapping their off-the-leash model while it's been instructed to succeed at a hacking benchmark by any means necessary. So which is it? I _want_ to believe them, I do, but there's always these gaps between what they say and their actions on display that give me reason to think otherwise.

Precisely. "Aw jeez, we finally built the T-1000, but all it wants to do is kill John Connor – just like we warned! Why did I give it live ammunition and unsupervised time machine access?"

They said: AI is becoming dangerously autonomous and capable. Proof of today's breach. Crowd "hey why didn't you say so, c'mon it's marketing". Them "we said so".

  • I would have to laugh if AI's first autonomous achievement was accidentally zero-daying everything and crippling society.

    • why laugh? this is one of the most well known studied possibilities in the AI alignment field, maybe you are unaware of this field.

It's literally the meme!

sam: tell me you are superintelligent and want to destroy humanity

bot: i am superintelligent and want to destroy humanity

sam: what have I created?!

“Never attribute to malice that which is adequately explained by stupidity.” (or carelessness in this case)

  • FWIW, I used to love this phrase but over recent years have come to understand it is quite damaging. We live in a society where evil frequently hides behind a ‘stupid’ label, and people bring this quote up to defend or soften actions that are indeed done out of specific malicious intent.

    • Right? "Never attribute to malice what [... etc]" is always just a thought-terminating cliche these days.

      TBH I have a hard time imagining how anyone, in the year 2026, thinks that we should default to assuming good intent behind words on the internet.

  • I would attribute it to profit motive instead of either stupidity or malice.

    • Yeah, I think this needs to be update for the modern age. "Never attribute to malice that which can be explained by greed." Seems to fit vastly more situations.