← Back to context

Comment by beepbooptheory

8 hours ago

If this speculated intelligence is so "super" why would it matter what its host country's commitments are? I would hope it would at least be intelligent enough to sort things out there? How can something be so potentially threatening, so "super," but also be like a baby, where we need to worry how its raised? Its super intelligent about everything except ideology? That doesn't really sound like (super)intelligence to me..

But ok, even granting that framing, if the issue is China's placement on the spectrum of "liberal", what would it take for them to be the good enough guys here?

I think it's more of a prestige discussion. Who leads, who follows, between countries. Not whose super intelligence is better. Who got their first, and how are they using it?

A supervillain is nevertheless super. Intelligence doesn't correlate with morality- most probably there doesn't exist a 'true ideology' that can be solved for in absolute terms. Do you imagine a superintelligence could calculate how beauty 'ought to' be traded off against truth?

When I say China is a bad choice because it's not as liberal as ~the west, I do imagine a reader in China thinking the opposite. I don't think they're dumb and I don't think they've been duped; they have a coherent ideology that fits their values. I just don't want it to stomp out mine.

Maybe I'm wrong and you can solve for morality or at least the meta-morality of Liberalism/pluralism where you permit various moralities to coexist. Hopefully so. Maybe the value system in China is closer to mine than I imagine and it's just operating under different constraints. But I don't want to gamble on that when winning is within reach and is a guarantee given alignment to any human values is achieved at all.