We built a complete production-grade inference service from scratch on a cluster of more than 100,000 Chinese-made AI accelerators. All production inference for GLM-5.3-Flash runs on this system.
Interesting that the tone of announcements between US and Chinese providers is converging.
GLM has in the past been more technical rather than speculation about future development on RSI etc.
Also curious whether those 100k accelerators are entirely locally made. If that's genuinely end to end on all components including lithography, memory, design etc then that is quite a feat.
Zhipu has built a production-grade inference service for GLM-5.3-Flash, running on a cluster comprising over 100,000 domestic AI accelerators. The practical application of GLM-5.3-Flash has given rise to a fundamental feedback loop: the model contributes to optimizing the inference infrastructure, while the optimized system continues to serve the model.
Necessity is the mother of invention. The shortsighted protections put on chips, etc., by the US has forced Chinese AI industry to adapt or die. Guess what their response to this fitness function has been? Kudos to Z.ai on their inventions and excellent write-up, which reads like humans wrote it.
Different angle on the same model: the full GLM-5.3 (744B MoE, 4-bit experts, 434 GB on disk) runs on a single MacBook Pro M5 Max with 128 GB
by streaming the experts from NVMe SSDs instead of keeping them in memory.
One drive gives about 2 tok/s; striped across four drives it reaches 3.5 tok/s with byte-identical output, and our best internal build with a not-yet-published patch does 4.2.
> This is known as Recursive Self-Improvement, or RSI.
Some call this "The singularity" (e.g. Hinton).
This is actually a core danger postulated by the, let's call it, "worrying" scenario - see AI 2027 (to be clear, I think its timeline is not realistic).
> Statements dreamed up by the utterly deranged.
Evidently, and tragically, it will take catastrophes to show that deranged are the ones deriding the worried crowd.
I was gonna ask how people found their coding plans, and realized, have they massively ramped up the prices? Seems the middle plan is ~$80/month now, didn't that used to be like $20/month? Cheapest plan is ~$20/month currently.
They must have hit really hard scaling limits if the prices were hiked so much so quickly.
I paid $360 annual for Max plan and currently averaging about 1BN tokens a day with their frontier GLM-5.3 model. This was clearly unsustainable for them and they've dropped this package.
I also have a legacy pro plan and the only limitation is if you are trying to work in the morning from Europe because you are in the 3x usage overlapping China time but after 12 or so you basically can run it at least for me at least 3 parallel sessions all the time.
Way to restrictive in terms of tokens provided. I am on their largest plan, and quickly run into their limits. And that is using it selectively in addition to codex.
>I was gonna ask how people found their coding plans
Very good - but I'm on a legacy plan. And coming up on a renewal that would put me on the watered down current plan. But with 50% legacy discount think it may be worthwhile. If I go to a competitor I'd be paying market rate.
>They must have hit really hard scaling limits if the prices were hiked so much so quickly.
Not really scaling - their plans were initially comically subsidized even more so than what the western providers are doing. More advert for an upstart than commercially priced.
It just gives a taste of what we are all going to have to pay soon, once the model providers actually have to make money. And the era of "let's charge a dollar for every 10 dollars running the infra actually costs" is rapidly coming to an end.
And you can bet GLM is still ridiculously subsidized, just not as ridiculously as Anthropic and OpenAI.
It's hard to know, since no one advertises the actual token limits (partially cause they're prolly complex / adaptive). So it seems much more likely that they just offer different pricing tiers than you're used to. Like, the $80 plan is still ~$80 of subscription quota, regardless of what else is offered.
For [API usage](https://openrouter.ai/z-ai/glm-5.3-flash#providers) they charge a bit more than the very cheapest providers of GLM-5.3-Flash, but not so much that a big price difference would make sense.
Well, other than the infrastructure they got from illegally routing millions of paying customers' requests through Anthropic's Opus 4.8 in a distillation attack...
That is such a canard, IMO. FWIW, Anthropic and OpenAI encrypt "thinking" token outputs in their models, while Chinese labs don't. If anything, it's more likely that everyone is using open-weight models in their synthetic training data generation pipelines. It's way easier to distill from logits than it is to distill from hard tokens.
Are you joking...? Sorry if so! Just in case: It's illegal in both the PRC and the USA.
In the PRC, they[1] leaked tons of national secrets on the PRC's latest AI campaigns, the inner workings of their "opinion monitoring" (read: performative panopticon) and "stability" (read: violent oppression) departments, Chengdu's whole CCTV network, direct-energy weapons plans, espionage activities in Syria to hunt down Uyghur refugees, and god knows what else that Anthropic didn't divulge to us common folk.
In the US, it's very clearly an attempt to rip off a competitor. I'm not sure how else you could possibly see it. Even if you're a distillation fan in general (which A. why and B. plz don't), they did this through a network of Japanese and Signaporean shell accounts, presumably at least some of which were abusing Anthropic's subscription service in a ToS double-whammy, as it would be exorbitantly expensive otherwise. They also had to hack around Anthropic's API to get CoT traces, which seems impossible to explain away as anything innocent.
I've been beating the "China isn't necessarily an enemy, it's gonna take us all to handle AI" drum for literally years, but this attack was just... gross. Gross in scale and gross in arrogance. Not a good sign for the dawning alignment crisis, to say the least :(
TL;DR: Use these services if you want, but know that you're supporting aggressive escalations and companies that very clearly don't give a flying fuck about violating the law, much less your ToS. So... buyer beware, I guess.
[1]: For clarity, Z.ai was not alone in this, nor were they most egregious attack -- Moonshot.ai (kimi) took that coveted prize. DeepSeek was involved, too.
This article left me with one immediate question: "WTF is GLM?".
Honestly, I have no idea what z.ai is either (I'm aware of an AI-enabled editor called Zed, but that's under zed.dev), so it's a bit presumptuous from them to assume that everyone is familiar with their product...
z.ai is a fairly well known AI lab out of China and their GLM models are probably the most popular outside of Anthropic or OpenAI’s. I don’t think it’s presumptuous for them to not introduce themselves in a post on their own blog, I think you’re just a bit out of the loop here.
Maybe my post sounded harsher than I intended, and yeah, it's probably on me that I'm not familiar with GLM. Actually the other major Chinese LLM Kimi does ring a bell, maybe it's because three-letter acronyms are a dime a dozen and annoy me because I'm confronted with them regularly at work too (people at my company seem to love acronyms), but that's obviously on me too...
We built a complete production-grade inference service from scratch on a cluster of more than 100,000 Chinese-made AI accelerators. All production inference for GLM-5.3-Flash runs on this system.
Most of the people had kinda guessed this when they decided to provide 100 trillion tokens for free.
[dead]
Interesting that the tone of announcements between US and Chinese providers is converging.
GLM has in the past been more technical rather than speculation about future development on RSI etc.
Also curious whether those 100k accelerators are entirely locally made. If that's genuinely end to end on all components including lithography, memory, design etc then that is quite a feat.
Any details on the latest approach to distillation would also be very interesting.
Zhipu has built a production-grade inference service for GLM-5.3-Flash, running on a cluster comprising over 100,000 domestic AI accelerators. The practical application of GLM-5.3-Flash has given rise to a fundamental feedback loop: the model contributes to optimizing the inference infrastructure, while the optimized system continues to serve the model.
Necessity is the mother of invention. The shortsighted protections put on chips, etc., by the US has forced Chinese AI industry to adapt or die. Guess what their response to this fitness function has been? Kudos to Z.ai on their inventions and excellent write-up, which reads like humans wrote it.
Different angle on the same model: the full GLM-5.3 (744B MoE, 4-bit experts, 434 GB on disk) runs on a single MacBook Pro M5 Max with 128 GB by streaming the experts from NVMe SSDs instead of keeping them in memory.
One drive gives about 2 tok/s; striped across four drives it reaches 3.5 tok/s with byte-identical output, and our best internal build with a not-yet-published patch does 4.2.
Method and numbers: https://github.com/argonautlabsai/argodrive (built on antirez/ds4).
seems unusably slow, and is this for short context?
[dead]
[dead]
[flagged]
Given the rate of improvement, why is this deranged?
because the rate of improvement is fairly stalled?
15 replies →
if you can be replaced by an algorithm, how useful were you really?
3 replies →
[dead]
[dead]
> This is known as Recursive Self-Improvement, or RSI.
Some call this "The singularity" (e.g. Hinton).
This is actually a core danger postulated by the, let's call it, "worrying" scenario - see AI 2027 (to be clear, I think its timeline is not realistic).
> Statements dreamed up by the utterly deranged.
Evidently, and tragically, it will take catastrophes to show that deranged are the ones deriding the worried crowd.
You are a singularity. Just a loop that processes a bunch of input and creates output.
Everything you think you are is just what you can imagine in a single moment. Nothing more, nothing less.
I was gonna ask how people found their coding plans, and realized, have they massively ramped up the prices? Seems the middle plan is ~$80/month now, didn't that used to be like $20/month? Cheapest plan is ~$20/month currently.
They must have hit really hard scaling limits if the prices were hiked so much so quickly.
I paid $360 annual for Max plan and currently averaging about 1BN tokens a day with their frontier GLM-5.3 model. This was clearly unsustainable for them and they've dropped this package.
1 billion tokens a day?!! I've done a lot of work these past 2 weeks with GLM-5.3. Like, a lot. And I've just passed 300 million tokens in total.
Can I ask where are you using all those tokens?
7 replies →
I also have a legacy pro plan and the only limitation is if you are trying to work in the morning from Europe because you are in the 3x usage overlapping China time but after 12 or so you basically can run it at least for me at least 3 parallel sessions all the time.
Way to restrictive in terms of tokens provided. I am on their largest plan, and quickly run into their limits. And that is using it selectively in addition to codex.
>I was gonna ask how people found their coding plans
Very good - but I'm on a legacy plan. And coming up on a renewal that would put me on the watered down current plan. But with 50% legacy discount think it may be worthwhile. If I go to a competitor I'd be paying market rate.
>They must have hit really hard scaling limits if the prices were hiked so much so quickly.
Not really scaling - their plans were initially comically subsidized even more so than what the western providers are doing. More advert for an upstart than commercially priced.
The way I look at it, their coding plan doesn’t retain data or use it for training making it one of the cheaper plans for me.
https://docs.z.ai/legal-agreement/privacy-policy
You believe any of these companies care about the law? They care about winning and building the self improving AI as quickly as possible.
5 replies →
Yeah it went from a great deal to unviable compared to other providers imo. They really need to find a healthy middle ground
It just gives a taste of what we are all going to have to pay soon, once the model providers actually have to make money. And the era of "let's charge a dollar for every 10 dollars running the infra actually costs" is rapidly coming to an end.
And you can bet GLM is still ridiculously subsidized, just not as ridiculously as Anthropic and OpenAI.
3 replies →
What provider are you using currently?
It's hard to know, since no one advertises the actual token limits (partially cause they're prolly complex / adaptive). So it seems much more likely that they just offer different pricing tiers than you're used to. Like, the $80 plan is still ~$80 of subscription quota, regardless of what else is offered.
For [API usage](https://openrouter.ai/z-ai/glm-5.3-flash#providers) they charge a bit more than the very cheapest providers of GLM-5.3-Flash, but not so much that a big price difference would make sense.
Well, other than the infrastructure they got from illegally routing millions of paying customers' requests through Anthropic's Opus 4.8 in a distillation attack...
We weep for Dario, that he had to suffer such a devastating attack against his Terms of Service.
That is such a canard, IMO. FWIW, Anthropic and OpenAI encrypt "thinking" token outputs in their models, while Chinese labs don't. If anything, it's more likely that everyone is using open-weight models in their synthetic training data generation pipelines. It's way easier to distill from logits than it is to distill from hard tokens.
https://x.com/EricSimons/status/2099252922098061714
What is "illegal" about it?
breaking Anthropic TOS and misleading users
1 reply →
Are you joking...? Sorry if so! Just in case: It's illegal in both the PRC and the USA.
In the PRC, they[1] leaked tons of national secrets on the PRC's latest AI campaigns, the inner workings of their "opinion monitoring" (read: performative panopticon) and "stability" (read: violent oppression) departments, Chengdu's whole CCTV network, direct-energy weapons plans, espionage activities in Syria to hunt down Uyghur refugees, and god knows what else that Anthropic didn't divulge to us common folk.
In the US, it's very clearly an attempt to rip off a competitor. I'm not sure how else you could possibly see it. Even if you're a distillation fan in general (which A. why and B. plz don't), they did this through a network of Japanese and Signaporean shell accounts, presumably at least some of which were abusing Anthropic's subscription service in a ToS double-whammy, as it would be exorbitantly expensive otherwise. They also had to hack around Anthropic's API to get CoT traces, which seems impossible to explain away as anything innocent.
I've been beating the "China isn't necessarily an enemy, it's gonna take us all to handle AI" drum for literally years, but this attack was just... gross. Gross in scale and gross in arrogance. Not a good sign for the dawning alignment crisis, to say the least :(
TL;DR: Use these services if you want, but know that you're supporting aggressive escalations and companies that very clearly don't give a flying fuck about violating the law, much less your ToS. So... buyer beware, I guess.
[1]: For clarity, Z.ai was not alone in this, nor were they most egregious attack -- Moonshot.ai (kimi) took that coveted prize. DeepSeek was involved, too.
6 replies →
Eh, even if this was true, then they're merely stealing from thieves. Anthropic did break a ToS or two to get training data themselves.
[dead]
This article left me with one immediate question: "WTF is GLM?".
Honestly, I have no idea what z.ai is either (I'm aware of an AI-enabled editor called Zed, but that's under zed.dev), so it's a bit presumptuous from them to assume that everyone is familiar with their product...
z.ai is a fairly well known AI lab out of China and their GLM models are probably the most popular outside of Anthropic or OpenAI’s. I don’t think it’s presumptuous for them to not introduce themselves in a post on their own blog, I think you’re just a bit out of the loop here.
It's only the top open-weights LLM in the world,
https://artificialanalysis.ai/#intelligence-category-tabs
It's presumptuous for them to assume that a reader of their blog is familiar with their product?
Also I feel like the obvious way to read the very first sentence is that GLM is a language model
> As we develop GLM, the model sometimes exhibits capabilities that surprise us
I don't get the outrage. Do you post this kind of stuff on every topic on hackernews that you are not knowledgeable about?
Maybe my post sounded harsher than I intended, and yeah, it's probably on me that I'm not familiar with GLM. Actually the other major Chinese LLM Kimi does ring a bell, maybe it's because three-letter acronyms are a dime a dozen and annoy me because I'm confronted with them regularly at work too (people at my company seem to love acronyms), but that's obviously on me too...
1 reply →
A ai model family similar to Codex, Gemini or Claude.
Where GLM-5.3-Flash is the newest "small / fast" model.
>As we develop GLM, the model sometimes exhibits capabilities that surprise us, and even unsettle us.
Come on now
Also, why would they introduce themselves on their own blog?