Comment by latexr

> It messes up sometimes (very rarely) but so do websites.

I disagree with “sometimes”. But anyway, the gargantuan difference is that with websites you can get a feel for their credibility. As a simple example, documentation on MDN is miles more trustworthy that your average SEO spam blog, and you can see this as soon as you enter the page. Yes, some scammers are craftier than other, but the signal is there.

With LLMs, all answers get the same weight.

And asking for sources is not reliable. They are too often made up or contradict what the page says.

> and I don’t even have to leave Google to get it.

And what will you do when most posts on the web are just junk SEO spam to trick LLMs into telling you what they want? It’s not like that’s hard to do, even.

https://www.anthropic.com/research/small-samples-poison

https://www.bbc.com/future/article/20260218-i-hacked-chatgpt...