Comment by andrewflnr

> Next, what's to say that a model can't "build theory", as hypothesized in this article

Well for one thing it would stop being a language model; I used that term very deliberately. It would be a different kind of model, not one that (AFAIK) we know how to build yet.