Comment by Skyy93
5 months ago
No it is not just search. Chain of thought is the generation of new context from the inputs combined with a divide and conquer strategy. The model does not really searches it just breaks the problem in smaller chunks.
5 months ago
No it is not just search. Chain of thought is the generation of new context from the inputs combined with a divide and conquer strategy. The model does not really searches it just breaks the problem in smaller chunks.
I don't get the distinction. Are you not just searching through chunks?
CoT is literally just telling an LLM to "reason through it step by step", so that it talks itself through the solution instead of just giving the final answer. There's no searching involved in any of that.
i don't write understand how that would lead to anything but a slightly different response. How can token prediction have this capability without explicitly enabling some heretofore unenabled mechanism? People have been asking this for years.
5 replies →