Comment by tristanj
5 hours ago
Chinese models are trained on dubiously collected model traces from Claude/OpenAI that are purchased from model routers. All the major Chinese models use this data. That's one reason they've been able to catch up with Anthropic/OpenAI so quickly, they have so much data.
Mistral can't train on that data, because this data would be illegal to purchase & train on in the EU.
It's dubiously collected data the whole way down. This is the AI industry.