← Back to context Comment by naveen99 6 hours ago Isn’t that distillation ? 1 comment naveen99 Reply mrfox321 6 hours ago No. Distillation trains on a teach model's logits or output tokens.
No. Distillation trains on a teach model's logits or output tokens.