← Back to context

Comment by laminatedsmore

3 years ago

I'd say that knowledge (stored as weights) is acquired through experience (starting from a mostly blank start, weights are formed through exposure to training data). For me that's a useful mental model which helps me think about what a LLM is and isn't.

'Understanding' has an ambiguous meaning, while thought and senses are certainly not applicable.

But it's a semantic discussion about a novel and not well understood topic so :shrug: :)

> But it's a semantic discussion about a novel and not well understood topic

I agree entirely.