Comment by jordanpg
11 hours ago
The lawyers I know are very fixated on the problem of hallucinated case citations which is amusing to me as a onetime programmer, since case citations have a well-defined syntax and would be relatively easy to check programmatically.
Which makes it all the more bizarre that LLMs have this problem. Claude Code runs the code it generates through a compiler, why can’t an LLM run its product through a cite checker? I’ve seen LLMs fabricate citations.
A modern frontier model with an agentic harness will check its citations if the system instructions or prompt tell it to.
You can get an effectively-zero hallucination rate with the right setup already.