Comment by andai
6 hours ago
>We trained Kolibri with abstention data and with our Merlin-Arthur protocol. As a result, it is trained to say "I don't know" when the answer isn't in the context.
https://aleph-alpha.com/en/blog/bounding-hallucinations-merl...
I'm not super impressed, at least in English. I asked:
(A made-up song and name) And received:
I saw similar responses for other questions. Qwen3.8-27B correctly refused without web search.
Just like Merl.
https://minecraft.wiki/w/Minecraft_Support_Virtual_Agent#Sys...
(for context, the Minecraft Support chatbot, aka Merl, had a meme because she kept saying "I don't know" to questions like "How to craft a diamond pickaxe".
My understanding is that this is why models hallucinate. The alternative is that they say "I don't know" to nearly everything.
Gemini gives me a lot of hard-no responses, and I think to myself, "well can you find out? what am i paying you for" usually
Gemini: Here's a list of links to check