Comment by root_axis

> When I retrain its original architecture, which still produces messy deep layers, and follow the least legible neurons I can find, they turn out to be overgrowing locally into reasonable, adjacent territory.

It's interesting to observe that human reasoning is still the barometer of what "reasonably adjacent" means in the context of a NN's structure.