← Back to context

Comment by consumer451

19 hours ago

Linus Torvalds:

~"Predicting the next token is not an insult. It's pretty much what we all do."

That's of course absurd. The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.

  • > The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.

    I don't know about you, but I tend to speak one word at a time...

    • >I don't know about you, but I tend to speak one word at a time...

      That isn't how tokens work, nor is it a representation of how the brain represents information.

  • Our brain decides every moment what action to take next, that best fits with what we did and felt so far. Language is kind hard to see because it's virtual, but imagine all other things you do. And then language works the same as everything else, same circuits, just no direct connection to muscles.