Comment by storus

There was a presentation at CS 25 Transformers United about some phenomena like chain-of-thought emerging only after training LLMs with at least 1T tokens and only in LLMs of certain size.

https://youtu.be/tVtOevLrt5U?t=923