← Back to context

Comment by xhevahir

4 hours ago

> And my lawyer basically just said "looks good to me" by the time they reviewed it.

Last year when i mentioned this application of LLMs somewhere on Reddit (in the course of arguing that white -collar workers are an endangered species) it was met with scorn by commenters who insisted that machines could never match the skill and care needed to write and review contracts and the like, at least not to the level demanded by the legal profession. Well maybe the human standard isn't that high to begin with; my dad was just telling me last night the story of how his lawyer had urged him to cave to a plaintiff's demands because the judge who was hearing the case "gets bored and doesn't like reading the documents." (The judge's son is currently running for the office of county prosecutor, lol.)

The expected next step then would be for such judges to use AI to read the documents.

You then get a decision that your AI agent explains to you.

What could possibly go wrong? You will have to ask your agent for that.

It's always been a silly argument that's also predicated on a massive fallacy which everybody is aware of but seem to conveniently ignore during these arguments: that humans never make mistakes.

On top of that, dealing with text is literally what LLMs are all about.

The problem with accuracy, hallucinations and just generally ensuring responses are grounded in factual stuff is in large part and engineering problem.

  • Machines can’t be held accountable, which is problematic in law particularly.