It would be great if they could use the LiDAR scanner to sign a depth map of the scene in front of the camera. It would show if you photographed a flat image.
The sensor already uses phase detection autofocus. You can create a depth map out of it. iPhone X used its dual cameras and that phase data for depth maps.
How would that work? I thought the premise here is that you can fool the apple camera by taking a (very carefully aligned) picture of a still image (printed out).
A depth map from the apple camera (again, signed) would show that the entire image had the same distance from the camera.
The photos are cryptographically signed in the apple image pipeline so it's not as simple as just AI generating something. That said, I can't see how this is any different to all the other times we have embedded crypto keys in consumer hardware where eventually someone finds a way to extract the key and the whole thing is busted open.
People have constructed video walls so high resolution they can film TV series in front of them and to an audience it's indistinguishable from a real set. It's extremely cost-effective for things like space fantasy that needs lots of exotic-looking backdrops, apparently.
It may not be in reach for you and I - but within reach of anyone with the budget to run a 'bot farm'
The high resolution video wall is quite simple. The hard part and why this has not been done earlier is that for filming, they had to synchronize the rendered background with the movement of the camera.
also no, even in the high rez video walls its still possible to tell. maybe to an "audience" no but there are lots of fundamental flaws with video walls that make them not the same as filming it for real. all of those flaws show up in the final image and could be detected.
things like color rendering, sharpness, screen door/morie, motion blur, and yup even good ole depth queues in the lens system all show up as artifacts.
case in point, outside of a few specific niche cases like the mandalorian, that virtual production video wall thing is not actually being used all that much because of the amount of post shoot cleanup required to fix all those issues, it wasnt actually that much cheaper and its not really better either. especially when you factor in how hard it is to shoot that way.
The credibility comes from who took the photo. The next logical and easy step is for this metadata to flow to the user agent. I'll know that it was taken by a legit journalist photographer. And id not, I can have my user agent make it fuzzy or replaced with
a kitten photo.
I think this is where we are headed. This feature seems useless on it's own since someone will eventually find a way to extract the key from the iphone and sign any image. But if they could make it so every iphone uses it's own key and the photos show "Taken by xyz" and it's linked to their icloud or identity somehow. That way images shared around will still be able to be linked to a source that you can choose to trust and the viewer can know it wasn't modified from what that person shot.
Then we might move to an age where photos which were not signed by someone will be treated as fake.
It would be great if they could use the LiDAR scanner to sign a depth map of the scene in front of the camera. It would show if you photographed a flat image.
The sensor already uses phase detection autofocus. You can create a depth map out of it. iPhone X used its dual cameras and that phase data for depth maps.
They could use the camera aperture to take a second photo and calculate blur.
If that became popular, the AIs would learn how to generate a realistic depth map along with any generated image.
How would that work? I thought the premise here is that you can fool the apple camera by taking a (very carefully aligned) picture of a still image (printed out).
A depth map from the apple camera (again, signed) would show that the entire image had the same distance from the camera.
1 reply →
The photos are cryptographically signed in the apple image pipeline so it's not as simple as just AI generating something. That said, I can't see how this is any different to all the other times we have embedded crypto keys in consumer hardware where eventually someone finds a way to extract the key and the whole thing is busted open.
7 replies →
Even simpler, a 3D printed relief with an image "stamped" on it, now you effectively have a 3D image.
6 replies →
The 'ol "analog hole". Never been able to patch that gap.
Yes, if your adversary can generate a high-fidelity 3D moving replica of a scene, they can deceive you that it’s real. But can they really?
And what if you take a picture across a IR-filtered window?
Then you won’t be able to prove it was a genuine photograph? That sounds like the right failure mode.
That's a cool idea.
Pretty sure it does that already.
One can 3d-print the AI generated image and photograph that. /s
that's an authentic photo, not the subject/image, the photo is authentic.
It will look like you took a picture of a screen or print out
People have constructed video walls so high resolution they can film TV series in front of them and to an audience it's indistinguishable from a real set. It's extremely cost-effective for things like space fantasy that needs lots of exotic-looking backdrops, apparently.
It may not be in reach for you and I - but within reach of anyone with the budget to run a 'bot farm'
The high resolution video wall is quite simple. The hard part and why this has not been done earlier is that for filming, they had to synchronize the rendered background with the movement of the camera.
1 reply →
also no, even in the high rez video walls its still possible to tell. maybe to an "audience" no but there are lots of fundamental flaws with video walls that make them not the same as filming it for real. all of those flaws show up in the final image and could be detected.
things like color rendering, sharpness, screen door/morie, motion blur, and yup even good ole depth queues in the lens system all show up as artifacts.
case in point, outside of a few specific niche cases like the mandalorian, that virtual production video wall thing is not actually being used all that much because of the amount of post shoot cleanup required to fix all those issues, it wasnt actually that much cheaper and its not really better either. especially when you factor in how hard it is to shoot that way.
1 reply →
If they’re spending millions on faking an image, okay fine. That’s clearly not the security model intended for this feature though.
1 reply →
Stamp only proves you did the photo and probably some metadata like when where etc.
It helps but doesn't solve credibility issue.
The credibility comes from who took the photo. The next logical and easy step is for this metadata to flow to the user agent. I'll know that it was taken by a legit journalist photographer. And id not, I can have my user agent make it fuzzy or replaced with a kitten photo.
I think this is where we are headed. This feature seems useless on it's own since someone will eventually find a way to extract the key from the iphone and sign any image. But if they could make it so every iphone uses it's own key and the photos show "Taken by xyz" and it's linked to their icloud or identity somehow. That way images shared around will still be able to be linked to a source that you can choose to trust and the viewer can know it wasn't modified from what that person shot.
Then we might move to an age where photos which were not signed by someone will be treated as fake.
4 replies →
Right. All of your pictures will include identifying information. Same will happen for LLM generated text.
what is it missing then?
I bet there exists data from the 3 cameras to represent some depth to the image.
Yes.