Comment by Peteragain
3 days ago
The article is actually about the way we humans are extremely charitable when it comes to ascribing a ToM (theory of mind) and goes on to the Gym model of value. Nice. The comments drop back into the debate I originally saw Hinton describe on The Newyorker: do LLMs construct models (of the world) - that is do they think the way we think we think - or are they "glorified auto complete". I am going for the GAF view. But glorified auto complete is far more useful than the name suggests.
Those billion parameters, they are a model of the world. Autocomplete is such a shortsighted understanding of LLMs.
They're a model of language, not of the world.
A model of language is a model of the world, else it being pure gibberish.
4 replies →