Comment by keybored
13 hours ago
Slop comes from food that is just mushed together to the point that the ingredients become indistinguishable. How that applies specifically to AI training should be obvious. It’s not a generic putdown.
Semantic diffusion? Not that I have high standards for hmm, curious but humans already X comments.
Online dictionary (Merriam-Webster) says: "digital content of low quality that is produced usually in quantity by means of artificial intelligence". So sure, semantic diffusion (I see you read Martin Fowler), I donno. Life is semantic diffusion.
In practice code gets worked and reworked and reworked. I work on code where every single line in a huge file was written by a different person. Even the initial implementation could often fit your definition of slop. Isn't human training also mushing things together?
But cool. I think the discussion mirrors the gap Andrej was talking about. Interesting times.