Comment by dingo_bat
8 years ago
Except looking inside a neural network is almost impossible. For example, google photos still turns mum if you search "gorilla". They could not figure out wtf was wrong with the recognition networks and had to just blacklist the keywords.
https://www.wired.com/story/when-it-comes-to-gorillas-google...
That's only an argument against using present-day neural networks as a basis for advanced AI. It's not a fundamental rule of reality that a mind can't understand its own internals.
It's not impossible, just time-consuming. It's the kind of task computers excel at but cannot currently do for general cases.