← Back to context Comment by krupan 16 days ago Still not deterministic 2 comments krupan Reply qarl2 14 days ago You understand that computer programs are deterministic unless someone explicitly injects non-determinism in them, right?Even when they implement LLMs. qarl2 14 days ago To the people downvoting me - I'm sorry, but it's true.I know ChatGPT seems like it's non-deterministic - but that just a user preference.The only real issue is if you have many people on the same server, the GPU contention can be non-deterministic in rare cases.LLMs can be deterministic if you need them to be - it's just that most people prefer the human-like interface.
qarl2 14 days ago You understand that computer programs are deterministic unless someone explicitly injects non-determinism in them, right?Even when they implement LLMs. qarl2 14 days ago To the people downvoting me - I'm sorry, but it's true.I know ChatGPT seems like it's non-deterministic - but that just a user preference.The only real issue is if you have many people on the same server, the GPU contention can be non-deterministic in rare cases.LLMs can be deterministic if you need them to be - it's just that most people prefer the human-like interface.
qarl2 14 days ago To the people downvoting me - I'm sorry, but it's true.I know ChatGPT seems like it's non-deterministic - but that just a user preference.The only real issue is if you have many people on the same server, the GPU contention can be non-deterministic in rare cases.LLMs can be deterministic if you need them to be - it's just that most people prefer the human-like interface.
You understand that computer programs are deterministic unless someone explicitly injects non-determinism in them, right?
Even when they implement LLMs.
To the people downvoting me - I'm sorry, but it's true.
I know ChatGPT seems like it's non-deterministic - but that just a user preference.
The only real issue is if you have many people on the same server, the GPU contention can be non-deterministic in rare cases.
LLMs can be deterministic if you need them to be - it's just that most people prefer the human-like interface.