Comment by chasd00

i think there's plenty of evidence of emergent behavior in llms already. This is the driving factor for just more parameters and bigger training sets, "If we just make it bigger maybe more unexpected behaviors will emerge".

idk how legit this is but the summary is my point https://arxiv.org/abs/2206.07682