Comment by liuliu

I think that is true for GLM-5.3 to some extents, this is not true for DeepSeek 4-series models as they compress KV aggressively.