Comment by angry_octet

17 hours ago

Exactly, there is no perfect process for such simplistic binary decision making. But we are seeing pipelines for tasks, like document processing, where it is becoming accepted that the machine is right.

Rather than binary classification we should be locating document fragments in a high dimensional feature space, and with all those fragments coming to a confidence bounded guess.

Additionally, when someone submits documents that can't be recognised as valid, the response should not be INVALID, it should be UNDECIDED. In that sense, passing to Opus is great, but passing a tiny fragment of the problem is a bad way to do it.