Comment by vonneumannstan
2 hours ago
Crazy how their models always come out after the US labs and just lag the performance of top models. Almost like they are performing distillation attacks... how strange.
2 hours ago
Crazy how their models always come out after the US labs and just lag the performance of top models. Almost like they are performing distillation attacks... how strange.
distillation attack? why the violent word choice? When OpenAI crawled Github was that an attack?
Distillation is not an attack. It simply a way to train a model. Not doing it when you are behind is akin to snatching defeat from the jaws of victory.
Do you have moat if your advanced model can be distilled in a month or two ?