Comment by mhitza

4 days ago

That is where their responsibility ends in terms of the EU AI Act. And that is fine and how it should be, no secret watermarks.

Watermarks should even be removable "if substantially proofread or altered" in the EU for the text from an LLM, that you verify to be as true as if you wrote it yourself. Not clear is this is a may, shall, or should. It certainly is not a must.

Watermarks cane even be removed, "if substantially proofread" in the EU, law says. For the text from an LLM, that you verify to be as true as if you wrote it yourself. Not clear is this is a may, shall, or should. It certainly is not a must.

  • (If you post a comment here on HN, then hit the back button, edit your comment, and click “reply” again, you end up posting multiple comments. That’s what’s happened here.)

  • It's not gonna survive my linter in a tightly coupled code base where it's not allowed to write comments but I do resent it for trying.

There's no way text watermarking isn't causing a degradation in writing quality.

  • Text watermarking will surely cause a degradation in quality writing.

    There's is no text watermarking that doesn't cause a decline in writing quality.

    Writing quality will surely deteriorate if text watermarking is implemented.

    • Maybe this is silly: what about zero-width spaces or other hidden characters? Add them in post-processing, and the response quality doesn't degrade (though rendering etc. might be wonky).

      4 replies →

  • A lot of random-ish numbers go into LLM output and there's a lot of room to hide signals in random-ish numbers.

  • The real problem is false positives. One false positives is enough to make the whole thing dangerous. The results can't really be acted upon without risking defamation. If you admit that you redistributed someone else's copyrighted work to an AI company that never forgets, it's an admission of distributing copyrighted works.

    The law should have at the very least required offline validation tools that cannot track or retain a copy of the documents being checked.

    • > offline validation tools

      As soon as the validator is available without a rate-limit, just apply input fuzzing to defeat it.

Watermarks can even be removed, "if substantially proofread" in the EU, law says (for now. There might be a transition period on that).

For the text from an LLM, that you verify to be as true as if you wrote it yourself.

Not clear if making watermarks removable is a may, shall, or should, according to legislation. It certainly is not a must.