Comment by spidersoverjoye
4 hours ago
Why only scenarios where humans remain in control? I think the kind of AGI needed for radical abundance would be difficult to achieve in a way that also does not lead to ASI
4 hours ago
Why only scenarios where humans remain in control? I think the kind of AGI needed for radical abundance would be difficult to achieve in a way that also does not lead to ASI
Agreed, I think AGI->ASI. My happy radical abundance stories are happy ASI stories mostly. And therefore much less likely.
BDFL / Benevolent Machine God is definitely one of the ways you can get a happy attractor. Seems scary to roll the dice on.
And yep, I include non-human totalitarian outcomes in the unhappy bucket.