Comment by wg0
5 months ago
CoT again is result of computing probabilities on tokens which happen to be reasoning steps. So those are subject to the same limitations as LLMs themselves.
And OpenAI knows this because exactly CoT output is the dataset that's needed to train another model.
The general euphoria around this advancement is misplaced.
[flagged]