Comment by FinchNova12
3 hours ago
"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the new approaches. So I wouldn't take the new approaches to be much evidence about whether the distillation attacks occurred.
> distillation attacks
Like the distillation “attacks” Anthropic conducted against literally millions and millions of different creators?
Scanning google is an ‘attack’