Comment by some_random
1 month ago
Distillation is objectively easier than training a model from scratch, that's why all these Chinese labs are doing it.
1 month ago
Distillation is objectively easier than training a model from scratch, that's why all these Chinese labs are doing it.
Training a model is objectively easier than generating the sum total of human creative output prior to 2020. That's why the big labs are doing it. What's the difference here?
Reverse engineering has stronger protections than merely copyright infringement