Comment by Terr_
3 hours ago
> LLMs are also quite deterministic if you want them to be
In the shallow sense that any PRNG is deterministic if you set the seed and if you control triggering order.
However that's not usually the situation/scope people are talking about.
I was just pointing out, in part, that the non-determinism is a choice, but I probably would have needed to go down a whole rabbit hole about exploration of search spaces etc.
My broader point is that it's not really the non-determinism that's an issue. What the other commenter seems to be looking for is something along the lines of repeatable correctness, where correctness is generally a requirement that the model doesn't have full access to. The non-determinism is an implementation detail here.