Comment by howunfortunate

In a general sense I mean something like "arising through complex interaction between parts", like the murmurations of certain birds or unexpected mechanics found in physics sandbox games.

In this specific instance I mean I don't think it was obvious given the structure of the model, it only "emerged" when we applied massive scale, which allowed for unexpected interactions to happen in the deep networks involved.