Comment by ziofill
2 months ago
Exactly, whether or not it’s the “actual thought” of the model, it does influence its final output, so it matters to the user.
2 months ago
Exactly, whether or not it’s the “actual thought” of the model, it does influence its final output, so it matters to the user.
> it does influence its final output
We don't really know that. So far CoT is only used to sell LLMs to the user. (Both figuratively as a neat trick and literally as a way to increase token count.)
Not even remotely true. It's part of the context window, so it greatly influences the final output. CoT is tokens generated by the LLM just like normal output.