Comment by pixl97
2 years ago
>ChatGPT would be a meaningless continuation of nonsense if it wasn't trained on text that already contains language
I mean, if you put a child in a room and severely neglect them, you don't get a child that can speak any form of human language, and you'll find they an extremely underdeveloped brain.
If you put your pet rock in a room and severely neglect it, it will fail to develop human language. That doesn't mean you can expect it to.
ChatGPT isn't magic, and it's not a person either. It's a language model. Specifically, it's an implicit model of semantics.
If you gave it pure random data to model, it would; and that model would be useless, because it is only patterns of noise.