Comment by massagedpelican
4 days ago
Out of curiosity, I ran the PDF through pangram and it seemed to flag nearly the entire thing as AI. I recognize these aren't perfect detectors, but they can give signals if nothing else. Perhaps it needs more soul injected!
https://www.pangram.com/history/93f9ec71-f7b3-4680-86b1-ff12...
Yeah, this doc is really interesting. It has some absolutely claude-fried lines like:
> A hook is Koa-style middleware: it reifies an endomorphic continuation
> Five forms, each on tool.call;
But on the other hand uses distinctly human phrases like “one may” and “etc./e.g.” that I rarely see LLMs use. Not sure what to think.
Maybe Claude is RLHFd primarily on texts by mpoteat and that’s why it talks this way
I know it's a joke but if you look at many of the key AI researchers papers (written pre-LLM mass adoption) you can see some similarities with how LLMs structure their output.
I'd love to do some stylometry on this...
I have found that Opus 5 and Fable love bringing up category theory at the drop of a hat.
Perhaps these "ai detectors" are snake oil
There’s definitely a snake oil component, but Pangram is unbelievably accurate. Creepily so in my opinion
How do you evaluate that?
1 reply →