Comment by PoignardAzur
3 months ago
My understanding is that o1's chain-of-thought tokens are in its own internal embedding, and anything human-readable the UI shows you is a translation of these CoT tokens into natural language.
3 months ago
My understanding is that o1's chain-of-thought tokens are in its own internal embedding, and anything human-readable the UI shows you is a translation of these CoT tokens into natural language.
I found this documentation from openai that supports my hunch: https://platform.openai.com/docs/guides/reasoning/advice-on-...
The reasoning tokens from each step are lost. And there is no indication that they are different tokens than regular tokens.
Where is that documented? Fwiw, interactive use suggests they are not available to later invocations of the model. Any evidence this isn't the case?