Comment by jacquesm
14 hours ago
Not buying that. You explicitly mention the model name in the title the 'GLM 5.3 workers AI model' suggests it is something specific to GLM 5.3 which it is not. You mention Sglang and are all surprised that it didn't throw an error. But the issue was yours all along.
Yeah, their title is absolutely implying a GLM bug to anyone who doesn't read it super closely.
There's a huge amount of unnecessary extraneous details in the headline that distract from "this is a Cloudflare bug".
Not sure if the title was edited but as is it is very clear to me this is a bug on their side and I have no idea how a technically literate person (someone using the model via cloudflare?) who would misinterpret given the reference to the cache.
The title is poorly worded. I can easily see how it can be conflated in passing. Naming the model is silly in the title. It should be mentioned in the article but as read the title suggests it’s something related to this model.
I have read this post, and it appears that this is indeed an issue specific to the GLM 5.3 model on their platform. I am unsure whether this is because only GLM 5.3 uses SGLang or because only its configuration is problematic.
Did we read different articles? None of the issues they brought up (architecture splitting, memory transport, Cloudflare's misconfigured context window provisioning, the SGLang state leak, lack of client error provisioning) are model related. These all exist at the layer of the harness (ie Cloudflare's configuration).
A better title would be "Cross-request KV cache exposure in Cloudflare provisioned GLM-5.3 Workers AI model" because it narrows culpability. Just posting it on the Cloudflare blog isn't enough for that in the age of AI and SEO data-scrapes and it'd be surprising to me if the authors didn't know that.
They could have removed GLM 5.3 from the title, and the title and the body would still make perfect sense.
I think it's in the title because it's also doing double-duty of informing customers that only usage of the GLM-5.3 model was potentially impacted. I agree that it's so what confusing, though.