Comment by dvt
4 days ago
A lot of times, this entropy decay is found in semantic or stylistic space, which would be hard to detect (you couldn't use, e.g., Shannon Entropy). You'd have to ask questions like "is this point uninteresting?" or "is this trope overused?"--bad (human) writers are often guilty of this too, so that's why AI can be hard to detect.
Yes, still though, it might be interesting to be able to measure this easily.
E.g. when asking an AI to rephrase or summarise, if the entropy drops you might take that as a sign that it has eroded the style beyond what you might be willing to tolerate.
I wonder if the author had a particular method / tool in mind, or if they were just speaking abstractly.