Comment by nighthawk454

At the risk of oversimplifying, it seems the field looked at neuron activations and couldn't find the pattern, so a series of convoluted hypothesis were proposed to explain it away. When the actual answer was the pattern was very simple they just missed it. Little bit embarrassing really.

The good news I guess is the actual patterns make a lot of sense with what you'd expect the neurons to do, and don't require nearly as much 'black magic who knows what wonders scale can create'.