Comment by randallsquared

17 years ago

In order to worry about Friendliness, you have to be first (otherwise it was pointless, as whether the first mover's AI was Friendly is what matters). So, you have to be relatively confident that you're already going to be first in order to spend much time researching Friendliness. I only know of one group that appears to be confident in that way (SIAI), and I have no reason to think that their confidence is less misplaced than all the other people who've been convinced they'd figured it out.

From the outside, SIAI seems torn along a Goertzel-Yudkowsky axis, with BG saying "whee, this is fun, lets build it", and EY too busy saving the world to panic. But the man himself reads Hacker News, so I'll shut up.