Comment by Marha01
5 hours ago
The model can realize it made a mistake earlier and correct itself in subsequent output. I have seen it happen many times in CoT.
5 hours ago
The model can realize it made a mistake earlier and correct itself in subsequent output. I have seen it happen many times in CoT.
That’s the point. It may or may not. It can derail it.
This realization is something you assign meaning to. For the model there’s no difference between either of these states.