Non-American maybe, but non-Chinese is likely impractical. We might not want their APIs, but we can't compete on energy and labour for training, even if it means buying licenses to host the weights (which CADA encourages). From China's perspective, what's the case for baking weights they can't sell? Some Chinese models already don't even have the Taiwan politics stuff baked in, those filters are only in their APIs.
I realised after writing this, the EU as is uncomfortably often the case, may be the real forcing function for what happens with US policy irrespective of the media campaigns we're presently seeing. Here's hoping for a steady trickle of stale ChatGPT weights leaking from EU infra providers in the long term.
> we can't compete on energy and labour costs for training,
Specialists are expensive everywhere. China is functionally 80s Japan surrounded by several Brasils and all the frontier AI work is being done in that first part, where labour is expensive - if only due to competition for top talent.
Using Chinese models is a bit like using Chinese solar/batteries instead of American gas.
Yes, if the Chinese stop trading, you can still use the existing solar panels (unlike the gas which you literally set on fire), but it's nonetheless a major vulnerability to not have any local know-how in creating important infrastructure.
Giving up all AI know-how and expertise to China just because they currently share their models would be a generational mistake.
Europe already got burned hard by this sort of thing too recently, and is now very sensitive to strateigic depencencies, and is working hard to lift them where possible.
I didn't say they did (though granted, I believe it's the case). What matters here is that countries without their own AI labs have multiple potential partners to choose from.
Having a third option significantly lowers the leverage that both China and the USA have over other countries.
Mistral is the only major non-Chinese contender in the AI race releasing open-weight models. I’d rather trust that French weights haven’t been backdoored than Chinese ones. Heck, I’d even trust Mistral more than Anthropic for sensitive work.
You have a number of other European providers of open-weight LLMs, such as Bielik and Aleph Alpha. They are not trying to compete at the frontier, but they sometimes develop original architectures. I am also a big fan of PleIAs' research in this regard, have a look at their Baguettotron
Bielik largely exists because, and this is also my own experience, even frontier models still make grammar/spelling mistakes in Polish - even more so now than in the past.
To Europeans at least, this is a big deal, especially because of cybersecurity capabilities.
It is of vital strateigic importance for Europe (and really the rest of the world too) that there are non-American, non-Chinese options for AI.
Non-American maybe, but non-Chinese is likely impractical. We might not want their APIs, but we can't compete on energy and labour for training, even if it means buying licenses to host the weights (which CADA encourages). From China's perspective, what's the case for baking weights they can't sell? Some Chinese models already don't even have the Taiwan politics stuff baked in, those filters are only in their APIs.
I realised after writing this, the EU as is uncomfortably often the case, may be the real forcing function for what happens with US policy irrespective of the media campaigns we're presently seeing. Here's hoping for a steady trickle of stale ChatGPT weights leaking from EU infra providers in the long term.
> we can't compete on energy and labour costs for training,
Specialists are expensive everywhere. China is functionally 80s Japan surrounded by several Brasils and all the frontier AI work is being done in that first part, where labour is expensive - if only due to competition for top talent.
Using Chinese models is a bit like using Chinese solar/batteries instead of American gas.
Yes, if the Chinese stop trading, you can still use the existing solar panels (unlike the gas which you literally set on fire), but it's nonetheless a major vulnerability to not have any local know-how in creating important infrastructure.
Giving up all AI know-how and expertise to China just because they currently share their models would be a generational mistake.
Europe already got burned hard by this sort of thing too recently, and is now very sensitive to strateigic depencencies, and is working hard to lift them where possible.
3 replies →
What makes you think the rest of the world trusts Europe more than the Chinese?
I didn't say they did (though granted, I believe it's the case). What matters here is that countries without their own AI labs have multiple potential partners to choose from.
Having a third option significantly lowers the leverage that both China and the USA have over other countries.
Mistral was silent on the frontier for quite some time so this is exciting to me.
It's hacker "news" not hacker "scientific breakthrough"
Mistral is the only major non-Chinese contender in the AI race releasing open-weight models. I’d rather trust that French weights haven’t been backdoored than Chinese ones. Heck, I’d even trust Mistral more than Anthropic for sensitive work.
It's the only non-Chinese open weights frontier model, so while not groundbreaking per se, still quite important.
Important for sovereignty, multi-language support, and choice.
You have a number of other European providers of open-weight LLMs, such as Bielik and Aleph Alpha. They are not trying to compete at the frontier, but they sometimes develop original architectures. I am also a big fan of PleIAs' research in this regard, have a look at their Baguettotron
Bielik largely exists because, and this is also my own experience, even frontier models still make grammar/spelling mistakes in Polish - even more so now than in the past.
There are many non-Chinese open weights models, just not very good ones.
That's why he has written "frontier"
1 reply →
Inkling!