Comment by impossiblefork
1 day ago
With a fixed seed there will be the same floating point rounding errors.
A fixed seed is enough for determinism. You don't need to set temperature=0. Setting temperature=0 also means that you aren't sampling, which means that you're doing greedy one-step probability maximization which might mean that the text ends up strange for that reason.
No comments yet
Contribute on Hacker News ↗