Comment by irthomasthomas
7 days ago
Would this include American models that where distilled from them? I'm thinking of the Anthropic models which respond as Deepseek when prompted in Chinese. More good news for OpenAI, I guess.
7 days ago
Would this include American models that where distilled from them? I'm thinking of the Anthropic models which respond as Deepseek when prompted in Chinese. More good news for OpenAI, I guess.
That’s not how it works. The training material in Chinese is more likely to mention DeepSeek. LLMs are not aware what model they are.
Of course the model doesn't know what model it is, hence Claude pretending to be deepseek. But whether they got that training content by proxy from the Chinese internet, or distilled directly from the model would not seem to matter for this law.
Do people distil open weights models? Why?
1 reply →
That's exactly how it works.
Anthropic says that if a model says they are an Anthropic model, that's it, it's distilled from Anthropic. They even use that as a "proof" DeepSeek is distilling their models.
Or do you want to say the Anthropic PR department is a bunch of liars and scammers?
I think people have been distilling their models... and I also think they're (Anthropic) liars and scammers... and I also think distilling (scraping) a model that was trained on scraped data is just fair turn.
1 reply →
[dead]