Scammers Sell Seeds for Exotic AI-Generated Flowers That Don't Exist

1 hour ago (404media.co)

Thank you for your purchase. Here is the seed to receive beautiful flowers: 735037659271543.

Use this with model Juggernaut XL v11 at 1280x720, DPM++ 2M Karras and hires fix set to 1.4. Unfortunately, we are unable to accept returns at this time.

When I work as a freelancer, I get a lot of requests lately to create fake AI manipulated images for scams. Especially requests to generate fake IDs using AI. Personally, I feel that there is a need for AI watermarks on image generation models, but at the same time, if watermarks become mandatory, it would effectively kill the business viability of those models. It feels like the same problem as guns and gun control.

those oversized "teddy bear" pictures are horrifying, looks like something from day of the triffids

We talk too much about hallucination and too little about the more mundane elephant in the room that AI, whatever its effectiveness, will simply be used more for scam and deception than positive uses.

  • I dont think a few scams here and there outweight positive usecases

    • I don't think a few stock photo replacements here and there outweigh the negative use-cases.

    • We're about to see our political campaigns flooded with fake videos, slander, fabrications, and misinformation. Used to be you could be relatively certain if something was a video it was too much effort to be photoshopped. Not true any more.

      2 replies →

    • It's not just a few scams though. It's a lot of scams, and a lot of propaganda, and a lot of CSAM, and even beyond the overtly negative, it's a tidal wave of slop in music, in publishing, in everything else.

      Some technology has more negative use cases than positive; this appears to be one of them.