Comment by AlecSchueler

> LLMs do it by ...

That they do it at all is the point and is what separates then from MP3 encoding algorithms. The "how" doesn't seem to me to be as important as you're suggesting.

You asked a hypothetical above about a different algorithm and now we've ascertained the reasons why that was reductive.

> LLMs never experienced ...

What is experience beyond taking input from the world around you and holding an understanding of it?