Comment by bigyabai

2 months ago

LLMs aren't known for being super deterministic.

LLMs are determistic. Just like everything else computers are capable of doing.

Commercial front-ends just hide the random seed parameters.

  • Distributed float math is not deterministic without introducing total operations ordering and destroying performance

  • It's not usefully deterministic in the way computers usually are. Sensitively identical input can still lead to wildly different outputs even if all randomness is crushed out.