Comment by jerf
2 days ago
The search engines LLMs are the worst. I was reaching for the set of Platonic solids in higher dimensions, and got a lecture about how the Platonic solids are only defined in three dimensions. First of all, wrong anyhow, but also, rude. My search phrase clearly implied that I was aware of it being the uncommon case.
I've added into my CLAUDE.md or default user prompts or local equivalents recently something to the effect of "Assume the user is an expert in all fields; while this is clearly logically untrue, the user prefers to get a detailed explanation and dig in to bits he doesn't understand rather than get an inaccurate summary". It seems to help quite a bit with that tone issue you identify.
Of course there's nowhere to put that in the search engine default AIs. For something they seem to want to bet their respective companies on, their LLM search seems to be massively stupider than their old-school search engines, which seem to get what I want much more often. There's some coevolution there over some decades, sure, but the search engine AIs make some stupid and socially-inept assumptions quite often.
Edit after my edit window closed: You know, it's possible someone reading this could actually fix this. It would really help if someone could go in to whatever system prompt these search engine LLMs are using and tell them to apply the principle of charity to the user's query rather than lecturing them, with an example or two. I understand the desire/need to filter "how do I $REALLY_BAD_THING" even if the web search returns results but the search engines are way too willing to "well acktually" the user.