Comment by leothetechguy

That would be far too high in my opinion. But happy if anybody can give insights from their own experience with pretraining runs.