Comment by utilize1808

6 months ago

I feel this is not the scalable/right way to approach this. The right way would be for human creators to apply their own digital signatures to the original pieces they created (specialised chips on camera/in software to inject hidden pixel patterns that are verifiable). If a piece of work lacks such signature, it should be considered AI-generated by default.

> If a piece of work lacks such signature, it should be considered AI-generated by default.

That sounds like a nightmare to me.

  • You aren’t specifying your point of comparison. A nightmare relative to what? You might be saying a nightmare relative to what we have now. Are you?

    We once considered text to be generated exclusively by humans, but this assumption must be tossed out now.

    I usually reject arguments based on an assumption of some status quo that somehow just continues.

    Why? I’ll give two responses, which are similar but use different language.

    1. There is a fallacy where people compare a future state to the present state, but this is incorrect. One has to compare two future states, because you don’t get to go back in time.

    2. The “status quo” isn’t necessarily a stable equilibrium. The state of things now is not necessarily special nor guaranteed.

    I’m now of the inclination to ask for a supporting model (not just one rationale) for any prediction, even ones that seem like common sense. Common sense can be a major blind spot.

    • > You aren’t specifying your point of comparison. A nightmare relative to what? You might be saying a nightmare relative to what we have now. Are you?

      Very fair point.

      And no, it’s less about the status quo and more about AI being the default. There are just too many reasons why this proposal, on its face, seems problematic to me. The following are some questions to highlight just a few of them:

      - How exactly would “human creators [applying] their own digital signatures to the original pieces they created” work for creators who have already passed away?

      - How fair exactly would it be to impose such a requirement when large portions of the world’s creators (especially in underdeveloped areas) would likely not be able to access and use the necessary software?

      - How exactly do anonymous and pseudonymous creators survive such a requirement?

Then you just point the special camera at a screen showing the AI content.

  • Sure. But then it will receive more scrutiny because you are showing a "capture" rather than the raw content.

    • Actually come to think of it, I suppose a "special camera" could also record things like focusing distance, zoom, and accelerations/rotation rates. These could be correlated to the image seen to detect this kind of thing.

      1 reply →

That seems like a horrible blow to anonymity and psuedonymity that would also empower identity thieves.

  • Maybe as the direct effect, maybe not. Also think about second order effects: how would various interests respond? The desire for privacy is strong and people will search for ways to get it.

    Have you looked into kinds of mitigations that cryptography offers? I’m not an expert, but I would expect there are ways to balance some degree of anonymity with some degree of human identity verification.

    Perhaps there are some experts out there who can comment?

  • Not necessarily. It’s basically document signing with key pairs —- old tech that is known to work. It’s purpose is not to identify the individual creators, but to verify that a piece of work was created by a process/device that is not touched by AI.

    • > It’s basically document signing with key pairs —- old tech that is known to work.

      I understand the technical side of the suggestion. The social and practical side is inevitably flawed.

      You need some sort of global registry of public keys. Not only does each registrar have to be trusted but you also need to both trust every single real person to protect and not misuse their keys.

      Leaving aside the complete practical infeasability that, even if you accomplish it, you now have a unique identifier tied to every piece of text. There will inevitably be both legal processes to identify who produce a signed work as well as data analysis approaches to deanonamize the public keys.

      The end result is pretty clearly that anyone wishing to present material that purports to be human made has to forgo anonymity/pseudonymity. Claiming otherwise is like claiming we can have a secure government backdoor for encryption.

  • there's very likely already some sort of fingerprinting in camera chips, à la printer yellow dot watermarks that uniquely identify a printer and a print job...

    • The way those work is primarily through a combination of obscurity (most people don't know they exist) and through a lack of real finacial incentive to break them at scale.

      I would also argue that those techniques do greatly reduce privacy and anonymity.