Comment by jordanpg
17 hours ago
> In time it may be that LLMs will be so good that we can't tell the difference.
I have to believe that we are within a couple of years if not months of this. This problem is too well-known to not be a major focus of the frontier labs' efforts.
My own feeling is that this signal will perhaps never fully go away. Not in months; most likely not in a couple of years.
Not least because it’s getting worse rather than better. But also because as AI gets better at writing like humans, humans will change how they communicate to avoid being confused with it.
Which will get a lot easier once human writing is nearly extinct. Now that could happen in two years.
Yeah, I swear AI writing is worse than it was. Part of my big model release tests has always been asking it to write a few chapters in different styles, and I swear they have slowly gone from really bad, to boring and plain (I remember Gemini 3 being peak of this), to now over-complicated and quite bad. My guess is that they were initially being trained on writing quality but that has taken a backseat since it's not really a profit generator.
I think the signals also show up in different ways to different people.
For example, I don't dislike the way Gemma 4 writes so much.
But I am British and Deepmind's output somehow seems more compatible with the way British people communicate (it's a very multinational team, I suspect that is an influence).
Other people pick up on Gemma's AI writing tells a little more readily than I do. I have a greater tolerance for Gemma (and Muse Glimmer) than ChatGPT or Claude (or Qwen).
They're still heavily RL'd on response formatting/clarity, and against common LLM-isms. Long form prose quality is expensive to RL so I expect this to languish for a while until other low hanging fruit has been picked.
The trouble is that it's not an intelligence problem. You can make an infinitely capable LLM. It will still have a default voice.
The reason people notice "AI voice" is not that the AI voice is itself remarkable. It's that it appears so frequently. Every literate person spent nearly their entire life reading text written by a variety of different individuals. Dozens of different voices in your morning paper. Hundreds of different voices on every web forum. You get the idea.
Now, imagine that all of those voices were replaced by one guy (or two guys, or three guys if you're a Gemini believer). Everything in the newspaper is written by one guy. Every comment on reddit, and HN, and the NYTimes comment section, all written by the same guy. Other people tell him what they're trying to say, but he's writing all of it. Some people might even ask the guy to write in a different voice, but the voice is just that guy doing an impression of someone else, it's not actually someone else.
That guy's voice would probably start to get pretty grating. You'd start to notice every tell, every frequent word choice, every formatting quirk. You'd start to wonder if that guy was actually a good writer, or if having him write everything was just more convenient for everyone. You might even start writing like him yourself. This would be true even if that guy was an absolute virtuoso of the language and his writing was unassailable in a vacuum.
If everyone is using the same (small set of) model(s), then it doesn't matter if the model is GPT-3 or Claude Legendarium 9. Unless the operator - which in theory doesn't need to be a human - is doing something to move it off of its default voice, the outputs are going to sound the same, and you're eventually going to figure out, and get annoyed by, its tells.