Comment by darod
1 month ago
You can argue that reverse engineering anything is as hard if not harder than engineering something. I can’t imagine distillation is any different.
1 month ago
You can argue that reverse engineering anything is as hard if not harder than engineering something. I can’t imagine distillation is any different.
Distillation is objectively easier than training a model from scratch, that's why all these Chinese labs are doing it.
Training a model is objectively easier than generating the sum total of human creative output prior to 2020. That's why the big labs are doing it. What's the difference here?
Reverse engineering has stronger protections than merely copyright infringement