Comment by fwip

That checks out, right? We're instructing LLMs to choose from the least "surprising" tokens at each step (modulo some temperature). It feels smooth, slippery - no friction to the eyes that glaze over as they skim the text, and no bumps to snag in your memory. Like waking from a dream, recalling only the barest shapes of a few concepts or themes, until it vanishes with your morning coffee.

The examples I've seen of AI music (though I avoid it on principle) seem the same.