Comment by Havoc
16 days ago
How on earth is anyone ok with 75% accuracy in prescriptions context?!? Or medical anything
That’s literally insane
16 days ago
How on earth is anyone ok with 75% accuracy in prescriptions context?!? Or medical anything
That’s literally insane
I'm guessing that human accuracy may be lower or around that value, given that handwritten notes are generally difficult to read. A better metric for document parsing might be accuracy relative to human performance (how much better the LLM performs compared to a human).
Nobody said they're okay with it, nor did they describe what they use the data for.