← Back to context Comment by naveen99 7 hours ago Isn’t that distillation ? 1 comment naveen99 Reply mrfox321 7 hours ago No. Distillation trains on a teach model's logits or output tokens.
No. Distillation trains on a teach model's logits or output tokens.