Comment by cmrdporcupine
1 day ago
Yes, the reckoning here will happen in a year or two when the (probably subsidized, maybe?) coding plans become either unavailable or much more costly.
It's also already the case that in larger companies people do not have access to these plans as employees and must use API rates.
There's also the political angle. When Anthropic and OpenAI held back their top of the line models because of Bessent & Trump's bullshit, and threatened to deny unwashed foreigners like me access... I dropped my Codex plan and made do purely with GLM 5.2 for three weeks before OpenAI finally released 5.6 Sol. Feels inevitable that this will happen again.
Or, somebody will come up with a way to serve e.g. Kimi K3 or the new Qwen model in an extremely cheap way. Or DeepSeek releases a competitive model at their cut-throat rates. And then the cost argument just wins.
k3 costs will go down at least 3x within a week of the weights dropping.
we'll get new quants, dspark speculators, distills and optimized kernels
as long as there are near frontier models available there will be inference providers selling them at or below cost of inference in attempt to get market share.
I have not seen that kind of significant drop with GLM 5.2 yet? so curious why you think it will happen for K3.
This is a very large model. Much larger (3x) than GLM. The resources to run it are very expensive.
There's been a price war going on openrouter between providers of GLM 5.2. NovitaAI, DeepInfra, and StreamLake keeps underbidding each other in waves. Yesterday evening both input and output $/M was ~$0.3. Output was especially cheap.
1 reply →