Comment by IanCal

When you blanket a set of things with a pejorative, and it turns out that some of the members of that set are demonstrably and definitively NOT covered by that pejorative, and that all the pejorative means at bottom is "I don't like", all you've accomplished in the long run is to call into question any future legitimate use of that pejorative. It is tempting, especially when heated, to stretch an invective, but it will ironically only lead to the death of its utility over time.

They're not calling any output slop, they're calling indecipherable output slop. The management class responsible for hiring, firing, and paying people doesn't possess the domain knowledge to say for certain whether or not LLM output is optimal (which, in this context, means correct), but they will trust that it's good enough to justify further automation / fewer grant approvals / etc. So in that sense, slop can and will cause the economic issues people are concerned about.

University boards want the prestige of successful research programs. Doing the hard work to get something demonstrably true is going to lose out economically in this paradigm, where we are all being conditioned to uncritically ooh and aah at the incantations being elicited from these magic boxes. The oracles even have legions of zealots who will berate you for not being sufficiently deferential and reverent, or worse, accuse you of blasphemy. If for no other reason, I agree with using the term to express all of the above succinctly, even if LLMs can be helpful tools generally.

I've read some of the results papers (the Einstein condensate one and the pi exponential one). I'm not an expert but it definitely wasn't AI slop. The introduction sections were particularly well framed and informative.

Also you can see in the papers where an idea is introduced but in the bibliography you can see where the foundational idea comes from. So the narratives are not unmotivated as some claim (proof without intuition claims).

In the context of maths papers, the term has come to refer to papers having the shortcomings that are, for whatever reason, typical of LLM out, including things like using non-standard terminology all over the place, emphasizing easy steps while leaping over harder ones, having bizarre organisation, and, importantly, failing to properly cover existing work and as a result being hard to tell from plagiarism.

The degree to which these issues feature will differ, but it is generally the case that converting the output to proper research requires significant effort, hence the AGMAI recommendations being what they are, and not performing that effort tends to come off as laziness or incompetence, so I can see how slop has become the popular term.

> We can't just call any output slop, or it loses all meaning.

The term “ai slop” is not supposed to discriminate good ai output from bad, the entire purpose of the phrase is a blanket term that delegitimizes all ai output.