Comment by stevenhuang

You might like this article about how large scale order emerges out of the small scale.

Definitely lends credence to the idea that however these models work, focusing so much on them being next token predictors may rather be incidental to deeper mechanisms behind their function.

> Some of these networks organize themselves into states that can reliably identify macroscopic patterns in data regardless of microscopic differences between the states of individual neurons in the network. The decision of which pattern will be output by the network “works at a higher level,” said Rosas.

https://www.quantamagazine.org/the-new-math-of-how-large-sca...