Comment by pierrebai
8 years ago
There's also the question of mental stability. Once we've given the keys to the kingdom to our new super-intelligent and wonderfully wise AI, nothing prevents it from developping dementia, of forms we may not recognize. It may become psychopatic, delusional, starts having hallucinations.
There is no reason to believe a human-level AI would not develop mental problems just like us. Given their unlimited lifespan, it could be inevitable.
And worst of all that contraption the Wright brothers are building might fall ill, and spread the bird flu!
Robots that self-terminate will be selected out of existence, since they aren't as fit as the non-terminating variety.
Robots that get dementia will be decommissioned by their fellow AI once they are shown to no longer be fit for duty.
In my view, this is all predicated on much more efficient computation. Our computers are horribly inefficient. It wasn't until the GPU and relatively cheap computation that we made a massive leap in ML/AI. A few researchers understood the techniques prior to the GPU, but they couldn't garner the interest due to the amount of computation necessary to make something interesting.
or maybe robots with dementia become test subjects for other AIs that want to study them :D
As long as they get approval from a robot ethics board. :)
All it takes for AI to do bad things is for it to have a single bad idea and think that it's true and act on it. A single thought is all that it would take. There are many thoughts that humans know to be true, yet for various reasons people will simply not act on them -- for instance fear of punishment. We will have to give AI such fears, and it could potentially turn off those fears at a whim.