Comment by rossant
2 years ago
I'm starting to see AI studies on the medical detection of child abuse, which unfortunately reproduce the same biases as the low-quality clinical data they are based on. An AI that would detect subdural and retinal hemorrhage without external signs of trauma with 99% accuracy would detect "child abuse with 99% accuracy" and would impress law enforcement and courts. However, it wouldn't be more reliable than an expert witness confidently asserting that these signs are almost always due to child abuse.
Reminds me of the bias towards long sleeves and stethoscopes for detecting doctors in photos.