Comment by emporas

>Astrological signs are predictive of birth dates, but they arent models of being born -- nor of time, or anything else.

Also eating ice cream and getting bitten by a shark do have some mutual predictive associations.

I think that the chess-GPT experiment can be interesting, not because the machine can predict every causal connection, but how many causal connections can it extract from the training data by itself. By putting a human in the loop, much more causal connections will be revealed but the human is lazy. Or expensive. Or expensive because he is lazy.

In addition correlation can be a hint for causation. If a human researches it further, then maybe it is a correlation and nothing substantial, but sometimes it may actually be a causative effect. So there is value in that.

About the overall sentiment, NN's world model is very different from a human world model indeed.