Comment by QuadmasterXLII
3 days ago
I guess it could also be that modern neural networks are so completely not equivariant that my linear algebra intuitions are no longer useful and it’s now common knowledge and or true that neuron 413 is just x[:, :, 413]
The neurons here are MLP neurons, with activations directly after the nonlinearity, so there is definitely a distinguished basis.