Comment by constantlm
5 hours ago
So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and novel approaches.
5 hours ago
So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and novel approaches.
Even if they are distilling, I don't particularly care. Anthropic and others have been distilling copyrighted material by to build these models, largely without permission.
Exactly,let Anthropic get back to training on the New York times.
this is so true honestly
If you redefine the technical world distilling to mean training on text, you are correct.
"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the new approaches. So I wouldn't take the new approaches to be much evidence about whether the distillation attacks occurred.
> distillation attacks
Like the distillation “attacks” Anthropic conducted against literally millions and millions of different creators?
Scanning google is an ‘attack’
No! It's just not fair!! What about our financial bubble!
"attack"