Comment by ahepp

>I wondered if you have tried running all of your own writings through it to verify that it thinks you are human. I was struck by Freddie deBoer's recent piece where he did this

Maybe I'm taking the "all" too literally here, but I read the article, and I'm not seeing anywhere the author ran a substantial portion of his corpus through Pangram to determine the false positive rate. That would be really interesting to see.

He does

* give an example of a piece of his writing that was, when ran in segments, flagged as generated (which he disputes)

* multiply the size of his corpus by pangram's published false positive rate and estimate that a few of his pieces would be flagged

* get the pangram model to label a piece "100% AI" when it only has 3 generated sentences

* demonstrate the ability to intentionally trigger a false positive