← Back to context

Comment by mmooss

1 hour ago

For SynthID and similar solutions, there is much I don't understand ...

Here's what I grasp: The AI system scores each token and then selects tokens based on those scores. If we encode something in the token selection routine ('in order choose the 1st, 3rd, 1st, 5th, 2nd, then 1st highest scored tokens'), we can identify AI-generated text by comparing sample text (ST) to the expected text (ET) for that prompt.

1) How do we score the tokens for the ET without the original prompt? Even a Markov-like process needs to start somewhere.

2) To recreate ET don't we need to maintain, until the end of time, the AI state - entire model and code - at the time of ST output?

3) Doesn't #2 require maintaining all states for all AIs? Often you won't know when and from which AI system the ST might have been generated. What happens when an AI vendor goes out of business?

4) To recreate ET, don't we effectively have to rerun the prompt? Won't rerunning it for every verification increase most costs of AI output by an order of magnitude? Most of what AI vendors do would be ST validation.

1. score by the past paragraph (this is also how the verifier checks without needing a GPU, it takes the previous length of text)

2. same answer

3. no, it just needs the previous text, private key, and the matrix math (CPU is fine)

4. no, see above.

  • Thanks ...

    1. So we can't score the first paragraph (or similar-sized block), and not short texts? Not deal-breaker, but a limitation.

    2. Doesn't the score vary by each AI system state - its model, programming, harness, etc.? Claude's output today doesn't match Gemini's, nor Claude from 2 years ago.