Comment by darby_nine
5 months ago
"chain of thought" is just search, right? Wouldn't it make sense to tailor the search with heuristics relevant to the problem at hand?
5 months ago
"chain of thought" is just search, right? Wouldn't it make sense to tailor the search with heuristics relevant to the problem at hand?
No, it's not search. It's feeding the model's output back into itself.
That's what all gpts are. This one is just allowed to start the answer a bit later not from the first word it generated. Unlike previous versions it was trained for that.
No it is not just search. Chain of thought is the generation of new context from the inputs combined with a divide and conquer strategy. The model does not really searches it just breaks the problem in smaller chunks.
I don't get the distinction. Are you not just searching through chunks?
CoT is literally just telling an LLM to "reason through it step by step", so that it talks itself through the solution instead of just giving the final answer. There's no searching involved in any of that.
6 replies →