Comment by thegeomaster

This amounts to a cost-saving measure - you can generate arbitrarily many tokens by appending the output and re-invoking the model.