Comment by numpad0
10 hours ago
I think buying Twitter for data was a blunder big as expecting self driving to be solved by 2015 or whenever it originally was.
It is only clear with hindsight, but now everyone knows that tweets are literally detrimental for LLM style AI for whatever reason. Personally I think it's because tweets are responses without CoT or prompts, or could be also because all its meat is in the shape incompatible with en-US culture, even when it's in English, though all that matters is it's actively useless.
He didn't buy twitter for data, he bought it to shut down criticism of himself and it worked
Maybe for training, but how about look up? I often use claude voice and grok voice (both on iOS) and reasonably frequently claude simply cannot find any info about a breaking topic, whereas grok always can.
I wonder if "no one says no" culture is practically the same thing as instructing LLMs to always hallucinate.
You know, LLM hallucination is a phenomenon where the AI would generate syntactically bulletproof chunks of text that are not grounded in reality. Lots of efforts by frontier LLM labs had been made in past few years to solve this by enabling AIs to refute premises in the prompt.
Ordinary people still need to be instructed to google stuffs. They don't go to a niche de facto non-American social media to be disappointed by its notoriously bad search to then conclude its notoriously dumb AI can be abused as a makeshift search tool. People are simply unable.
Twitter has been doing so much things backwards lately. That's reminiscent of how hallucination hurts whatever you do with AIs.
Hallucination is not something specific to LLM by any means.
Remember when you were a kid, your teacher probably told you "At an exam, leave no question unanswered, even if you don't know what to write. Nobody is penalised for wrong answers, but even total gibberish might sometimes add a half-point to your score".