Comment by eru
5 months ago
If you fix the random seed you use for sampling, your LLM is perfectly deterministic.
And there's no requirement for C compilers' UB to be deterministic either.
5 months ago
If you fix the random seed you use for sampling, your LLM is perfectly deterministic.
And there's no requirement for C compilers' UB to be deterministic either.
No comments yet
Contribute on Hacker News ↗