Comment by wyrdcurt
2 hours ago
Except that even the exact same model won't output the exact same results, that's a fundamental aspect of how LLMs work. They're probabilistic/stochastic, not deterministic.
2 hours ago
Except that even the exact same model won't output the exact same results, that's a fundamental aspect of how LLMs work. They're probabilistic/stochastic, not deterministic.
Models are weights for matrix operations, they are determenistics.
They are weights for matrix operations, so in principle you'd think they would be deterministic. In practice it's more complicated than that.
Not to be snarky or dismissive, I mean this genuinely: ask an LLM about it. I currently have a headache so I'm not up to explaining the technical details, but they are interesting and worth reading about.