Comment by palmotea

> ...but the takeaway here seems to be that LLMs are more confident with the initial data that they see and are less likely to chose exploration over exploitation.

You don't say!

"That confirms the real bug: <this obviously totally irrelevant thing that's obviously not the bug, which would take two seconds to disconfirm>."

"You were right to push back..."