Comment by kooi
8 hours ago
It happens outside the developer world as well.
People get information from Google AI mode and take it as 100% truth. In reality, blogs, reddit, and junk are often sourced link...which is fine if you inspect the sources...which some people don't!
Have has examples of people AI-moding a questing and they get one answer based on how they asked. Then another person asks and they get another answer.
Issue: People read what they want to read, don't listen to humans anymore beacause the AI will tell them what they want.
The problem described in the article existed for ages even before the internet.
People just want to pay their bills and don't want to use up their limited cognition beyond what's minimum.
For example, I work for 3 different employers. They don't know and I don't care if they find out. I use AI exclusively. I don't have Kubernetes experience but I am managing their infrastructure without issues. I will just read whatever LLMs give me and repeat it back. It has never failed me and there's no need to learn something that AI will do much better job at.
Sometimes I'm not even at my desk, I go to the gym and exercise instead which is a better use of time only answering on Slack when they ping me.
I mean at the end of the day, if it works, it works!
I've seen it using a lot of Instagram lately too. I can't even check that source because I don't have the app installed.
When I do try to check the links, they often don't support what's stated. If I call out Gemini, it says something inane like "I don't actually use these links the way a human might --- I didn't misinterpret it because I didn't even read it!"
Recently I was searching for information about fig trees (the fruit). It kept telling me things that didn't make sense, luckily the links revealed it was answering about fiddle leaf fig trees (the houseplant). Unfortunately that was not a correctable problem --- it kept happening even after I pointed out the mistake. So I'm really not too sure what the purpose of the system is. You still have to read through the references in their entirety (if not paywalled!), and with skepticism. And then if you find a problem, AI isn't going to get back on track.
Oof, is it a fig tree or a fiddle leaf leaf tree, that's hilarious.
There's the new pelican bench mark