Comment by thegeomaster

5 months ago

This amounts to a cost-saving measure - you can generate arbitrarily many tokens by appending the output and re-invoking the model.

0 comments