Comment by dopamine_daddy
20 hours ago
I tried my best to avoid leakage. If you're curious about how I trained the detector I have a writeup on it: https://unslop.run/blog/how-our-ai-text-detector-works
FYI this is all relatively new so there might be lots of issues and iterations coming.
My honest first impressions, since I think the project is well intended: This writeup is itself AI, and I would venture to call it slop. The Calibration section is borderline uninterpretable, and I challenge any non-author who claims to understand it to answer some basic peer review questions about it.
I have to concur, unfortunately. This isn't reliable, reproducible, or interpretable.