Comment by ajsnigrutin
2 days ago
Real time notifications here would solve a lot of issues...
Imagine Alice, an 18, 19yo girl, having a boyfriend, Bob, and since Bob is on a student exchange, she decides to send him a boob photo. Since alice is skinny, her boobs are on the smaller side.
Now imagine Alice hitting 'Send', and getting an automated message from whatever CSAM AI bot:
"Your message has not been sent, the system detected the breasts in the photo to be probably underage, the photo was forwarded to <your local police station> for manual review"
And half an hour later
"Detectives Rob Johnson, John Robson and Bob Bobson from police department XY, have done an extensive manual review of the photo of the breasts and have 2:1 decided that they're probably not underage, so the photo was sent to the intended destination. Than you, your friendly CSAM AI bot!"
I think you're probably wildly overoptimistic about the ratio of police officers to private nudes.
No government really wants to be fully enforcing all their own laws, just because it's way too expensive to hire that many cops. I think the closest anyone got was the Stasi, and they had a lot of "volunteers": https://en.wikipedia.org/wiki/Unofficial_collaborator#Other_...
I think a more realistic system would be hashing images and comparing them to known CSAM in some database.
I think Apple was going to implement something like this a few years ago before scrapping it.
Such systems are unfortunately trivially defeated by, for example, adding rings of colourful blocks around the edges of the image. If the scanning systems are then updated to notice rings around the image, bad actors will start cutting images in half and adding the colours there, etc. It's a never-ending arms race that's bound to leave regular people worse off.
Don't you think modern image analysis tools such as llms will be easily defeated by measures such as adding colored rings?
A couple of years ago you could add some pixels to an image to change it's automatic classification from cat to ostrich. But the tech has improved and I think the race has now firmly been won by the side trying to de-obfuscate images, and only in rare scenarios can images actually be obfuscated efficiently and consistently.
1 reply →
That assumes no new material is being created.
"But the call was coming from inside the house": https://www.robertkinglawfirm.com/mass-torts/grok-lawsuit/
I don't really want governments, Apple or Google to build databases of CSAM, thank you :/
It already exists. Most CSAM tools are checking against a hash database.
Why would you NOT want this to exist? This seems the only method to not raise false positives.
1 reply →