Comment by root_axis
16 hours ago
That's of course absurd. The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.
16 hours ago
That's of course absurd. The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.
> The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.
I don't know about you, but I tend to speak one word at a time...
Do you restart the entire sentence in your head every time you add a new word?
>I don't know about you, but I tend to speak one word at a time...
That isn't how tokens work, nor is it a representation of how the brain represents information.
Our brain decides every moment what action to take next, that best fits with what we did and felt so far. Language is kind hard to see because it's virtual, but imagine all other things you do. And then language works the same as everything else, same circuits, just no direct connection to muscles.