Comment by utopcell
14 days ago
How are Maverick and Scout distilled from Behemoth if the latter is not done training? Do they distill from some intermediate, "good enough" snapshot?
14 days ago
How are Maverick and Scout distilled from Behemoth if the latter is not done training? Do they distill from some intermediate, "good enough" snapshot?
Yes, during training multiple checkpoints are created, you can distill from any checkpoint you want.