Comment by ActorNightly

Sure. Its not a hardware problem though, but an algorithm problem. And to train something that behaves like a human can't be done with backpropagation in the way its implemented currently. You basically have to figure out how to train neural nets that are not only operating in parallel with scheduling, but also be able to iterate on their architecture.