When you ask an LLM a question about cars, it needs an inner representation of what a car is (how imperfect it may be) to answer your question. A model of "language" as you want to define it would output a grammatically correct wall of text that goes nowhere.
A model of language is a model of the world, else it being pure gibberish.
A model of language is a model of a tiny specialized part of the world: language.
And if anybody gets annoyed that my comment is tautological, get annoyed by the people that made the comment necessary.
When you ask an LLM a question about cars, it needs an inner representation of what a car is (how imperfect it may be) to answer your question. A model of "language" as you want to define it would output a grammatically correct wall of text that goes nowhere.
2 replies →