Comment by unclebucknasty

>LLM prose is annoyingly dense, and the useful information gets lost in a bunch of noise.

This problem doesn't get talked about enough and is second only to the hallucination problem IMO.

AI produces so much noise to wade through in order to find signal, and the more expertise you have in a field the more that costs. That noise directly subtracts signifcantly from productivity gains.

And, I think the problem is directly related to the hallucination problem. It feels very much like an effort to kitchen sink the response in order to provide some value among possible hallucinations.

It also seems to be a byproduct of Gen AI operation. It just fundamentally doesn't understand what it's outputting, so doesn't know how to narrow down to the most salient bits.