Comment by GetTheFacts

>It's muscle-memory for me. And so is it for LLMs.

LLMs have neither muscles nor memories. They're token combinators based on statistical correlation, no more, no less.

That's not to say LLMs can't be useful when they string together tokens. Quite the contrary, in fact. But let's not pretend LLMs are something they're not.