Comment by astrange

It does not guess the next word, the sampler chooses subword tokens. Your explanation can't even explain why it generates coherent words.