Comment by wat10000
2 days ago
Most LLM software isn’t deterministic, sure. But LLMs are just doing a bunch of arithmetic. They can be 100% deterministic if you want them to be.
2 days ago
Most LLM software isn’t deterministic, sure. But LLMs are just doing a bunch of arithmetic. They can be 100% deterministic if you want them to be.
In practice, they definitely are not.
Only because nobody cares to. Just like compilers were not deterministic in practice until reproducible builds started getting attention.