← Back to context

Comment by consumer451

17 hours ago

Linus Torvalds:

~"Predicting the next token is not an insult. It's pretty much what we all do."

That's of course absurd. The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.

  • > The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.

    I don't know about you, but I tend to speak one word at a time...

    • >I don't know about you, but I tend to speak one word at a time...

      That isn't how tokens work, nor is it a representation of how the brain represents information.