Comment by utopcell
10 months ago
How are Maverick and Scout distilled from Behemoth if the latter is not done training? Do they distill from some intermediate, "good enough" snapshot?
10 months ago
How are Maverick and Scout distilled from Behemoth if the latter is not done training? Do they distill from some intermediate, "good enough" snapshot?
Yes, during training multiple checkpoints are created, you can distill from any checkpoint you want.