Comment by pmarreck
3 days ago
How very machiavellianist-libertarian of you.
Don't even try to combine it with any notion of "leadership" then, however, since distillation is literally "copying the actual leader"
3 days ago
How very machiavellianist-libertarian of you.
Don't even try to combine it with any notion of "leadership" then, however, since distillation is literally "copying the actual leader"
It really isn't, you can improve by distilling a weaker model
Self-distillation is also a technique.