Comment by staticassertion

Emergent behavior would imply that some other function was being reduced to token prediction. Behaving "better than random" ie: not just brute forcing would not qualify - token prediction is not brute forcing and we expect it to do better, it's trained to do so.

If you want to demonstrate an emergent behavior you're going to need to show that.