Comment by rrr_oh_man

> but the takeaway here seems to be that LLMs are more confident with the initial data that they see and are less likely to chose exploration over exploitation

That’s why I’m of the (slightly contrarian) view that good context management is considerably more bang-for-buck than any type of harness, agent, or other fancy new bandaid of the month.