Comment by jdw64
2 hours ago
When I work as a freelancer, I get a lot of requests lately to create fake AI manipulated images for scams. Especially requests to generate fake IDs using AI. Personally, I feel that there is a need for AI watermarks on image generation models, but at the same time, if watermarks become mandatory, it would effectively kill the business viability of those models. It feels like the same problem as guns and gun control.
AFAIK the big models have watermarks that are supposed to be hard to remove. But I don’t think it’s possible on local models: not just questionable because it would prevent full open-source, but if someone discovers a way to easily remove a local model’s watermark, it will work permanently.
It’s a bit analogous to New York and California regulating 3D printers (which I disapprove). But more invasive, because local models are software, and here the danger is not guns but photos.