Comment by atleastoptimal
1 hour ago
What is the difference between what LLM's do and "true" understanding?
I feel like people grasping straws on the shrinking limitations of AI systems are just copying the "god of the gaps" fallacy
1 hour ago
What is the difference between what LLM's do and "true" understanding?
I feel like people grasping straws on the shrinking limitations of AI systems are just copying the "god of the gaps" fallacy
> What is the difference between what LLM's do and "true" understanding?
The thing where you can understand the meaning of this sentence without first compiling a statistical representation of a 10 trillion line corpus of training data.
Unless you're an NPC of course.
I mean brains get a lot of training data too in order to understand language. I don't think you provided a relevant difference.
Or rather, maybe I don't understand what you mean :)
When you think about the word apple and what it signifies, what do you experience? Is there a feeling of "appleness"? Do you think that sense of meaning is equivalent to the numerical weights of an LLM?