Comment by questionable_ju
3 days ago
>Maybe I need to reread his book, but I think of System 1 as "fast, reflexive, instinctive" mental activity, and System 2 as "slow, deliberative, rational, verbal" thought.
Current LLMs are the opposite of slow and deliberative, though? With the current transformer architecture, it seems like its function is more or less "look at this text and make a guess which word comes next", which is very much a fast and intuitive task. Any reasoning comes from CoT, which is more analogous to System 2 thinking. But that System 2 thinking can't function at all without relying on the representations from System 1 thinking (which are formed in pretraining).
So you could argue System 2 thinking is some part of the LLM, but it can't be 100%.
And when you think, how do you know which word will appear next in your mind? Or does your system 2 thinking seem to emerge as a spontaneous stream of words/thoughts?
I actually think that AI has little to do with the brain / human intelligence, but in this regard, human thinking is also spontaneous, where the next thought just seems to emerge from the combined effect of all inputs to your brain (including the memory of recent thoughts).
[flagged]