Comment by carstonh
12 hours ago
155T tokens/day per cluster? OpenRouter reports that last week total usage on their platform was 164T tokens. Surely all that demand couldn't be satisfied with one cluster? Are these different units of token, or maybe something got lost in translation?
OpenRouter routes traffic through many different providers
https://openrouter.ai/deepseek/deepseek-v4.1-flash-1017#prov...
Exactly... I was going to post exactly this and you called it two minutes before me. On openrouter, it is shown that 600T+ tokens are provided per month, so 20T+ per day. Openrouter is not all the world but it seems that something is not right with this 155T figure... Unless everyone is idle everywhere, waiting for demand
Isn't OpenRouter only part of the traffic of DeepSeek's inference?
Yes, it is only a part of DeepSeek's inference. Alongside openrouter there are others (probably many) doing this gateway work (for example opencode and even huggingface). Also the gateways in China itself, and of course also non gateway inference, DS itself directly providing inference.
From the Github benchmark numbers, one GPU can do about 26k tokens/s when serving 256 users, which is about 2.25B tokens/day. A cluster would need to be close to 70k GPUs to serve 155T tokens/day (which seems doubtful).