Comment by ComputerGuru

14 hours ago

This is incorrect. You cannot identify the presence of text watermarks if you do not have access to the models so that you can spot where expected tokens diverge from actual tokens based off the weights. That does not preclude Pangram from being able to reliably identify LLM-generated text from models whose outputs they’ve trained their own detection model upon.

They have unwatermarked text from the same base models, human text, and watermarked text.

If they couldn't train a reliable detector with that they wouldn't exist.