Comment by hollerith

I'm not so worried about this part as I am the part where a lab loses control of an AI, and it goes on to pursue whatever meaningless objectives (meaningless to us, that is) its designers accidentally gave it, and no one can stop it because it is better at planning and better at reality than we are.