Comment by nl

7 days ago

Deterministic seeds barely work on a single machine, small scale training run.

They just don't work at all on a many month long, 100K+ GPU cluster training run.