Comment by wat10000
1 day ago
Most LLM software isn’t deterministic, sure. But LLMs are just doing a bunch of arithmetic. They can be 100% deterministic if you want them to be.
1 day ago
Most LLM software isn’t deterministic, sure. But LLMs are just doing a bunch of arithmetic. They can be 100% deterministic if you want them to be.
In practice, they definitely are not.
Only because nobody cares to. Just like compilers were not deterministic in practice until reproducible builds started getting attention.