Comment by sedan_baklazhan
16 hours ago
It is insane how many times I see this false analogy repeated on HN over and over (analogy of a deterministic-by-design calculator device (or a compiler, etc.) and a non-deterministic-by-design LLM software).
16 hours ago
It is insane how many times I see this false analogy repeated on HN over and over (analogy of a deterministic-by-design calculator device (or a compiler, etc.) and a non-deterministic-by-design LLM software).
LLMs are not non-deterministic by design. The randomness in the output is artificially injected for ergonomic reasons. (Yes, the non-determinism in production systems is different, but also not by design)
You don’t train calculators on how to add. All calculators will more or less come up with the same answer to some deterministic and quantifiable level of accuracy and precision.
Nothing is deterministic.
Nothing is stopping LLMs to be more deterministic/correct over time.
Also you yourself is nondeterministic :)
>Also you yourself is nondeterministic :)
All people are. That is how automation appeared to begin with - to provide deterministic behavior.
You're missing the forest for the trees here. The point OP is trying to make is that calculators originally were essentially non-deterministic. Technology will go from unreliable to reliable.
Calculators never were non-deterministic by design.
Non-deterministic calculators are called dice.