Comment by robomartin

One of the things I've been noticing are lawyers getting annoyed when they realized you spent time working a matter with an LLM. In the cases I've seen, it had nothing to do with the quality of what came out of the LLM. It seems to be related to --and this is only my perspective-- a reality where now reasonably intelligent/experienced clients are coming to them with a case fairly well digested, whereas before they would have to pay the law firm tens of thousands of dollars to ingest documentation and information and do the digestion.

In a couple of instances I've come to the table better informed about the relevant law and case history than the attorneys were. In many ways I think this is a matter of people understanding that none of us are infinite human databases, so you can't know everything. Instead of rejecting LLMs (perhaps being passive-aggressive), they should embrace them as well as better-informed clients.

Having used LLMs for software development I know full well just how terrible they can be if you don't know what you are doing, don't guide the work correctly, etc. So I am not taking legal LLM analysis as ground truth, but it isn't garbage either.