Comment by notsureaboutpg

It is a violation of their rights. But we have a justice system set up which makes distributing such images knowingly (and committing such acts with the intent to distribute those images) a crime.

It's also incredibly likely this could be used to send people you don't like to prison by sending their phone innocuous images that look like wrong images to an AI.

It's also also incredibly likely this will evolve into scanning for more than just abuse photos, especially in the hands of governments around the world.