Comment by libraryofbabel
2 days ago
Unless you have evidence from a mechanistic interpretability study showing what's happening inside the model when it creates comments, this is really only a plausible-sounding just-so story.
Like I said, it's a trap to reason from architecture alone to behavior.
Yes I should have made it clear that it is an untested hypothesis.