Comment by exabrial
7 days ago
The irony is the Chinese are being very democratic with their models, while the USA tries to do central control.
Glad to see centralized control fail on the grandest scale. Maybe we can learn a thing or two.
7 days ago
The irony is the Chinese are being very democratic with their models, while the USA tries to do central control.
Glad to see centralized control fail on the grandest scale. Maybe we can learn a thing or two.
What you're seeing is the distilled (no pun intended) result of realpolitik at play. China's labs aren't as open as they are out of altruism, but rather to capitalize and undercut the monopoly held by U.S. competitors.
This is pure speculation. China labs are geeks and nerds like some of us. They were amazed at LLM and like everyone want to build their own. They were happy to get meaningful next token predictions. I think most of you forgot how bad these things were 3 years ago compared to today. There was nothing to undercut, it was just geeks putting out their toys and saying, "Look, I built something cool". That became the culture and led to were we are now. All this idea that they are trying to undercut the monopoly is speculation. Google still releases open models, Cohere releases command-a, Mistral releases their model too, Arcee and Thinking Machine have released models too. It's just that Chinese models have gotten good and are also leading in the open weight category and USA has a very strong paranoia of Chinese models hence this talk. Plus every time they release something, some of the labs cry, "they copied us, distillation, the bad guys have done it again!"
So what we are seeing is nothing more but geeks doing geeky stuff, the only one that has serious demonstrated that there are possibly be had is Anthropic and the Chinese labs are beginning to copying them in terms of user plans, coding tools, etc. They are giving away the model to show it's great. Once they have the compute to serve the world and they have a model just as good or better than top model, they will go close to keep all the profit.
You are ignoring the US and EU politics about regulating access to and distribution of and legal use of models. From my admittedly slightly limited perspective, it looks like China is politically more laid back about those developments than the western nations are.
This is true, but when we compare them to OpenAI's repeated feints at altruism and nonprofit structure, the irony is plentiful.
They wanted capitalism, no? Here's the competition in the market.
Yes, hah. Historically, the US got its moment to define for everyone what the rules of capitalism and globalization are, and China then played to win.
Is kimi making a profit? How subsidized is it by the Chinese government?
6 replies →
I'm reminded of space race, where US built centralized planning, while USSR did competition between construction buros
> The irony is the Chinese are being
There's no irony. The problem is these generalizations and labelling that's hurting everyone. It's the wrong way to view China and maybe many other places.
Just like the definition of AI, the definition of democratic or not evolved long ago.
[flagged]
[flagged]
They distilled Fable, in the couple weeks it was available?
The idea that the Chinese labs cannot make progress except by copying superior American products is just prejudice against the former and exceptionalism of the latter at play. Even the OpenAI top brass have admitted otherwise [1]. China is an equal match in every respect, and we'd better admit this to ourselves sooner rather than later so as to see the game clearly.
[1] https://xcancel.com/deanwball/status/2078133895766114412
1 reply →
Yes, distillation is very very easy.
So if they paid for pre-training they would not be able to open their weights?
Not if they want to recoup their investment.