Comment by directevolve

In a study like this, there’s also a difference in motivation. An AI will mechanically “take the study seriously.” I’m not convinced the doctors will.

But when making decisions about a real patient’s care, a doctor will be operating under different motivations.

They can also refer patients to a specialist, defer a diagnosis until they have more information, use external resources, consult with other doctors.

Doctors aren’t chatbots. They are clinical care directors.

Presuming there are no issues with information leakage, it’s genuinely impressive AI can perform this level of success at a specific doctoring skill. That doesn’t make it a replacement for a doctor. It does make it a useful tool for a doctor or a patient, which is exactly what we’re seeing in practice.