Comment by podocarp
1 day ago
I have no evidence at all, but could it be that repeating the same thing over and over again in the context makes models latch on to it wrongly and gives them more confidence despite it being wrong? Kind of like a sunk cost fallacy…
Although I do acknowledge sometimes they too point out something I thought was quite right but turns out of be wrong…
A session is a screenplay between someone called User, and someone called Assistant who is a helpful and competent assistant to the user. Harnesses bring in tools to the screenplay.
A screenplay where a character has done a certain thing is one where they're more likely to do it again.