Comment by sanxiyn

LLMs actually do have such hunch, they just don't utilize it. You can literally ask them "Would you do better if you started over?" and start over if answer is yes. This works.

https://arxiv.org/abs/2410.02725