Comment by pixl97

>and this has been tested by feeding in thousands of texts written before 2020.

And these text didn't train the model in the first place? I just want to ensure clarity on that.

>pangram currently has a false positive rate of about 1 in 10000

Says Panagram.

The problem with just looking at old text is language is a living thing. Say for example I make up the world 'oklambroahaha' right today. Both humans and AI pick up that word and start using it. Now lets say the model says that anything that uses oklambroahaha is 100% AI, you can't just point and say, "well my detection AI is correct on things 20 years old, so it's right skibbidy toilet 6/7".

There is a ton of evidence that use of AI changes the way we speak and write, so it will just turn these AI detectors into bullshit generating classifiers.