Comment by theptip

> whether the complexity is "ahh we think this neuron does 100 seemingly unrelated things but we don't understand it" or "this actually is some kind of latent shared feature, but we don't know what the concept represents because the composition of the entire circuit is an arcane algorithm",

The claim is closer to the latter (monosemanticity) but also claiming that the concepts are mostly comprehensible and not arcane.

(The best arguments against this being a full solve of interp that I’ve seen go like: “we expected most of the complexity to live in the circuits, anyway”.)