Comment by ionioagnio
12 hours ago
I thought it was pretty well understood amongst experts that trying to interpret so-called "chain of thought" is anthopomorphization and that the actual "thought process" of models is already opaque.
12 hours ago
I thought it was pretty well understood amongst experts that trying to interpret so-called "chain of thought" is anthopomorphization and that the actual "thought process" of models is already opaque.
I think this is a false dichotomy. The chain-of-thought can provide interesting information even if it isn't perfect. In any case, we should work to move in the direction of increasing fidelity, not decreasing it.
> I thought it was pretty well understood amongst experts that trying to interpret so-called "chain of thought" is anthopomorphization
Ah, experts... Chatting with a bot is no less "anthopomorphization" that chain of thought, should we stop doing that too?