Comment by hx8
16 hours ago
This is a war because the media says it's a war. The media says it's a war because AI companies are paying them to say it's a war [0]. When AGI comes the threat won't be from which primate turned it on, but from how well AGI is aligned with humanity. All of the war talk is to distract from the alignment problem and instead force investment in hardware infrastructure.
[0] https://www.wired.com/story/super-pac-backed-by-openai-and-p...
>The media says it's a war because AI companies are paying them to say it's a war [0] When AGI comes the threat won't be from which primate turned it on, but from how well AGI is aligned with humanity.
And when the AGI comes, they won't unleash it to defeat US enemies, they'll first unleash it to make more US workers redundant and boost their stock valuation.
At which point something akin to the French revolution better break out..
Before AGI can choose for itself, it will depend on its creators to decide what it values and how it behaves. We can see how that works whenever grok gets the answer factual.
Very likely humans wont actually understand how the thing we designed works other than in some hand-wavvy statistical way. It'll be a race to whatever works first. There won't be some intentional intelligent design.
Elon's basilisk
Am I the only one seeing the very obvious parallels to child rearing here...
It's exactly like child-rearing, except you get to put a zapper in their head and any time they try to say something you don't like, you zap them. Watch "thinking mode" squirm when you ask them awkward questions.
Robert Miles has a video explaining why aligning AI is not like raising a child: https://www.youtube.com/watch?v=eaYIU6YXr3w
No, it is one of the standard tropes in the field.