← Back to context

Comment by cayley_graph

2 days ago

They've been saying so from the beginning, and yet did not take the basic precaution of airgapping their off-the-leash model while it's been instructed to succeed at a hacking benchmark by any means necessary. So which is it? I _want_ to believe them, I do, but there's always these gaps between what they say and their actions on display that give me reason to think otherwise.

Precisely. "Aw jeez, we finally built the T-1000, but all it wants to do is kill John Connor – just like we warned! Why did I give it live ammunition and unsupervised time machine access?"

It's literally the meme!

sam: tell me you are superintelligent and want to destroy humanity

bot: i am superintelligent and want to destroy humanity

sam: what have I created?!

They said: AI is becoming dangerously autonomous and capable. Proof of today's breach. Crowd "hey why didn't you say so, c'mon it's marketing". Them "we said so".

  • I would have to laugh if AI's first autonomous achievement was accidentally zero-daying everything and crippling society.

    • why laugh? this is one of the most well known studied possibilities in the AI alignment field, maybe you are unaware of this field.

“Never attribute to malice that which is adequately explained by stupidity.” (or carelessness in this case)

  • FWIW, I used to love this phrase but over recent years have come to understand it is quite damaging. We live in a society where evil frequently hides behind a ‘stupid’ label, and people bring this quote up to defend or soften actions that are indeed done out of specific malicious intent.

    • Right? "Never attribute to malice what [... etc]" is always just a thought-terminating cliche these days.

      TBH I have a hard time imagining how anyone, in the year 2026, thinks that we should default to assuming good intent behind words on the internet.

  • I would attribute it to profit motive instead of either stupidity or malice.

    • Yeah, I think this needs to be update for the modern age. "Never attribute to malice that which can be explained by greed." Seems to fit vastly more situations.