Comment by SllX
5 days ago
By checking the citations rather than taking what’s generated at face value.
If it’s important, check it. If it’s not important, then it is pretty much just entertainment.
LLMs can be very useful in a general web search and save some time, but if you don’t put those literacy & critical thinking skills to the test and actually confirm anything, then you might as well not even have bothered with the search at all unless you’re hoping it can just replace all of your original thinking too.
If google didn't intend it's answers to be taken at face value it would just present the citations in a list of links rather than generating an answer.
Obviously the marketing point of the AI tools is it just gives you an answer straight up so you don't have to bother reading normal sources.
The AI summary is still useful for narrowing down the results, even if you fully check the citations.
> Obviously the marketing point of the AI tools is it just gives you an answer straight up so you don't have to bother reading normal sources.
To lazy people yes. That would be a marketing point. It’s not that though, so you use it to save time, but you don’t get to skip the verification step.
Google should not be publishing a statement that they haven't verified. This is different to listing search results links, they are the ones publishing the content here.
A journalist could not make up a harmful statement about someone and get away by saying the readers should have all read the sources. AI companies want to take all the benefits and profits, while holding none of the liability and responsibility for the harms they are causing.
4 replies →
Absolutely not.
LLMs are, for all intents and purposes, the equivalent of outsourced workers.
Google created a summary, not just sharing search results.
Google is responsible for the output it created and then published.
If they had only surfaced search results, then they would not be liable for what other people generated.
Google’s scale does not protect it from this liability.
If you re-read the article, you might see that it mentions that the citations do not necessarily cover the AI summary. The linked pages do not make the claims that the AI summary makes. That is the context of the ruling. Google made up the claims, and provided false citations. They are not, in fact, providing a summary, but a whole new narrative. Therefore they own it.
I read the article and I’m aware of the failure modes of Google’s AI summary. They’re actually one of the worst in the space on this shit which is why I don’t use Gemini and it’s fine that they get slapped for this, but what I was responding to initially was this:
> errors can be so subtle that it is not possible to recognize them unless you spend an hour researching every fact presented. at that point, what's the benefit of AI? nobody is going to do that.
Because if someone goes through the citations and it doesn’t substantiate what was generated, then what was generated was obviously bollocks. Being able to recognize those contradictions is an essential skill to using LLMs with web search at all. It’s not rocket science.
> Being able to recognize those contradictions is an essential skill
My eyes are brown.
I dislike coffee.
My phone is on the desk next to me right now.
One of these is false, and the other two are true. Can you recognise which is which? Or do you not have this "essential skill"?
When you're being given information about a topic you don't already know about, there's no skill to be able to recognise which pieces of that information are correct and which aren't. Either you know the information already, or you don't.
nobody has that skill. in order to recognize a contradiction you have to already know something contradictory. if you don't then you can't recognize anything. the only other reason to make you check is that you are very suspicious of this AI thing. you and me are, but who else is? you can repeat a thousand times that people should not trust an AI summary and they will not get it. they have neither the motivation nor the energy to do that research.
it's like saying people should not use a computer if they don't know how to keep it secure.
you have to look at the reality, which is that people are not educated or critical enough to use AI safely. and that misinformation can cause people to get killed.
just yesterday there was a post about a man being falsely accused of a crime by AI tools and losing his job and his family as a consequence.
these mistakes destroy lives, and most people are far to trusting to use AI tools safely
Important for whom exactly? If it's you who are called convicted pedo by Google AI summary, it's you who has vital interest in additional research but not me who reads it. There's intentions mismatch. Which probably would destroy your life, and you won't call it "entertainment" then, I think.
Strawmen are for scaring off the crows, not discussion fodder. Take it out to the farm where it belongs.
Could you elaborate what in my thesis of intentions mismatch makes you think it is not a valid argument?
But you are not doing a 2 hour rabbit hole search when you stand in front of a T-shirt and check whether it is fair traded or all-american produced.
If those are things you legitimately care about before you spend one penny on a T-Shirt, then you are. Or you did your research before hand. Or you’re just not buying the T-Shirt.
Or you don’t care about those things at all, and you will buy the T-Shirt that’s in front of you right now rather than wait later and buy one that better reflects your supposed values when you’ve done an appropriate amount of research. Using AI may even reduce the amount of time you spend on that part.
Your T-Shirt buying patterns & values are not my concern though.
You are confusing who is the party that is injured--as many in this thread are. We are not talking about the consumer who buys a non-fairtrade t-shirt, when he would rather had a fairtrade one. It's about the t-shirt producers who is legitimately fairtrade but whose business is now in the shitter because of a lying AI.
1 reply →