Comment by mrshadowgoose

Look up "mechanistic interpretability" in the context of LLMs. The next token prediction machinery is just a foundation for a higher order learned structure that appears to encode specific concepts, regardless of input language.

The analogy to humans is that the human brain is "just atoms bouncing around", but there's unquestionably something "more" going on that just that.