Comment by LeoPanthera

Gen-C coming right up.

It's also a lot easier to get caught when you're not paying full attention to whatever is being sent your way. Say an algorythm starts playing AI music while it's just playing in the background, or a friend posts something silly that you read sideways.

Wouldn't it be lovely if we didn't rush headlong into making things worse at the first sign of profit or power?

I mean I've seen people saying that whole "oh, it's just so good you can't detect it" a lot but not any actual evidence. I guess sentence can be short enough to not look clauded, but aside from that smells are still very common even for the best frontier models, so how anything else would be indistinguishable ?

It's different to me from text written by another person, because it is awful in a way that even a bad human writer can't replicate without first performing a lobotomy on themself.

A great mental model here is that if you talk to many people, each one has their verbal ticks, their repeated phrases, the preferred idioms, but... you don't notice because you speak to each acquaintance only for a few minutes or hours at most at a week. If you really know someone, since you were both kids, or whatever, then you can often learn their particular style and even mimic it.

If you think of the the frontier AI models as people, there aren't hundreds or thousands of "intelligent human-like machines" that you're speaking to, there are like... two: whatever the best model is made by Open AI or Anthropic right now.

A programmer might be reading (or at least skimming) thousands of pages of text from just one (or at most two or three) models a week, week after week, for months now.

It's like the entire world is talking to two aliens that have stepped of their glittering spaceship. The aliens can hold millions of conversations at once, but they have only two personalities, so... that's what everyone is getting, and everyone has learned to recognise.

What makes things even more obvious is that unlike humans, the models don't "self adjust". On the contrary, they are inherently amnesiacs, and hence don't realise that they're awfully repetitive! A human using the same phrase fifty times in a row will dial it back a notch, but these dials are the weights of the models and are frozen for each released version.

Yeah. The big LLMs have fairly idiosyncratic writing styles. Smaller finetuned LLMs can be quite different (and you can also tune them on a particular person's writing). I think some of the confidence in this is because there's plenty of cases which just don't get noticed.

This is probably possible now. Back when machine learning was all the rage people were using it to identify authors of various anonymous works. It became an introductory project to identify the Federalist Papers authors. Just read in some works, identify patterns, set up tests, and set the LLM into a loop testing whether the output would be predicted to be the author you are trying to impersonate.

https://towardsdatascience.com/hamilton-a-text-analysis-of-t...

Why this, of all things? It's horrible, but look at where the school was, why did they put a school there? Who puts a school next to a military base? There's way darker stuff than people missing a military base and hitting an adjacent school by accident.