Comment by lukewarm707
3 days ago
"a network’s own mechanisms are its [...] building blocks" is tautological.
> > "the standard evidence we had for that belief was misunderstood."
The author did NOT misunderstand the evidence of polysemanticity and superposition. Rather, the explanatory hypothesis was incorrect.
The word "legible" is the critical part of that sentence.
No: "a network’s own mechanisms are its legible building blocks"
Yes: "mechanisms within networks are legible"
or even, "networks are more legible than we thought".