Comment by mdp2021
9 days ago
A procedure is agnostic past the procedural rules (a calculator only follows a determined flow the way anyone could do without relevant differences); a stochastic process is inherently personal (non deterministic processes have internal biases).
In your example:
-- "iteration over filenames table reaches end → file not found";
-- "non-deterministic choice over lookup strategy does not return a positive → sorry I could not find the item"
LLMs are 100% deterministic. The facade of randomness is injected solely by a superfluous rng factor.
Even if in the forward pass there would be no "temperature" tilting, the NN training would still be performed through different processes on different implementations, making the outputs "personal".