Comment by qgin

Unless you’re running at temperature 0, there’s not one single token that the model definitely would have chosen each time.