Comment by bee_rider 2 days ago Or however deterministic inference is supposed to happen. I don’t know LLMs. 1 comment bee_rider Reply janwirth 2 days ago https://152334h.github.io/blog/non-determinism-in-gpt-4/
https://152334h.github.io/blog/non-determinism-in-gpt-4/