← Back to context

Comment by block_dagger

5 hours ago

This common response is pretty uninteresting and misleading. They simply predict tokens? Oh. What does the brain do, exactly?

It does exactly the same, predicts tokens, but it's totally different and superior to LLMs /s

OTOH, brain tokens seem to be concept based and not always linguistic (many people think solely in images/concepts).

  • LLMs are “concept based” too, if you can call statistical patterns that. In a multi-modal model the embeddings for text, image and audio exist in the same high-dimensional space.

    We don’t seem to have any clue if this is how our brain works, yet.

The brain has intrinsic understanding of the world engraved in our DNA. We do not simply predict tokens based on knowledge, we base our thoughts on intelligence, emotions and knowledge. LLMs neither have intelligence nor emotions. If your brain simply predicts tokens I feel sorry for you.

Edit: really does not surprise me that AI bros downvote this. Expecting to understand human values from people that want to make themselves obsolete was a mistake.

  • > The brain has intrinsic understanding of the world engraved in our DNA.

    This is not correct. The DNA encodes learning mechanisms shaped by evolution. But there is no "Wikipedia" about the world in the DNA. The DNA is shaped by the process of evolution, and is not "filled" by seemingly random information.

    • > But there is no "Wikipedia" about the world in the DNA.

      Im surprised as to how you got to that conclusion by my wording. I never claimed u have something like a knowledge base in ur DNA...

      1 reply →