Comment by zorked
14 hours ago
It's not deterministic due to implementation details in floating point numbers and order of execution.
If you ran an LLM with infinite precision and guaranteed order of execution, it would be deterministic.
(I think determinism is overrated. Being deterministic does not make LLMs more reliable or correct.)
Finite precision would work fine.
Non-determinism is injected, on purpose.