Comment by joquarky
8 days ago
> If nothing durable was learned, no changes are needed.
Off topic, but oh my god if you don't do this, it will always do the thing you conditionally requested it to do. Not sure what to call this but it's my one big annoyance with LLMs.
It's like going to a sub shop and asking for just a tiny bit of extra mayo and they heap it on.
Llms generally seem trained with the assumption that if you mention it, you want it.
I don't think the instruction following benches test for this much and I don't know how you'd measure it well