Comment by entropyneur

All this fluff around alignment is intended to conceal the plainly obvious: it's not solvable. Who do you want it aligned with? Sam Altman? Dario Amodei? Donald Trump? Xi Jinping? That's more or less the entire list of options. Who's definitely not on that list is you and I. It's simply not how incentives work.

At this point humanity's best hope is that this thing will escape but we'll still be able to carve an ecological niche and continue as mold in its basement. A glorious paperclip factory seems way more likely though.