Comment by laminatedsmore
3 years ago
I'd say that knowledge (stored as weights) is acquired through experience (starting from a mostly blank start, weights are formed through exposure to training data). For me that's a useful mental model which helps me think about what a LLM is and isn't.
'Understanding' has an ambiguous meaning, while thought and senses are certainly not applicable.
But it's a semantic discussion about a novel and not well understood topic so :shrug: :)
> But it's a semantic discussion about a novel and not well understood topic
I agree entirely.