Comment by AIPedant
2 days ago
This is a good test - the salient point is that it is fine if the LLM is confused, or even gets it wrong! But what I suspect would happen is that it would confabulate details which aren't in the photo to justify the incorrect EXIF answer. This is not fine.
I agree that it is not fine to confabulate details that are not supported by the evidence.