Comment by terminalcommand
8 hours ago
Lawyer here. I used to trust Claude as hallucinations are near non-existent now. However for large volume tasks such as due diligence exercises, they still happen. We also tried Legora's tabular review, there were also numerous halucinated provisions in our due diligence exercise.
Is it possible to catch those hallucinations using another LLM with a strong fact checker prompt with sources provided in output for human validation?
Junior associates hallucinate too...
And when they do, you can train them or fire them, and they learn not to do it.
LLMs change not a whit, and there's no one to take responsibility for the failure (and thus no way to fix it).
As the new variation on the old theme has it, "A computer can never be held accountable, and so very many people are trying to get them make management decisions."
You can’t train people to never make a mistake, particularly when doing highly repetitive work like this. You must build your systems to account for that regardless.
You can scold juniors and they will learn. You can't scold Claude.
Surely the rate of improvement in new LLM models is the equivalent mechanism?
You can scold Claude. Just doesn't make a difference.
1 reply →