Comment by flangola7
3 years ago
>for them personally there's no difference between no AGI/ASI and aligned AGI/ASI
Not really true. There are things worse than death and every AI researcher who is width their salt knows this.
Human level intelligence already inflicts not only great amounts of pain but drawn out, unusual, and unnatural durations of pain. So we know artificially enhanced suffering is a risk of intelligence.
I did not say there was no difference between the other pairs, obviously there's a difference between aligned AI and no AI, and between unaligned AI and aligned AI, I'm saying if aligned AI takes so long to create that you'd be dead first, to you personally it's the same as it not existing.