Comment by aftbit

I'm not sure how many tokens/sec you were running through your MBP. Let's just go with 35 tok/sec for the sake of having a number. 35 tok/sec * 3600 sec/hr * 2 hr/day * 365 day/yr => 91 million (output) tokens. At DeepSeek's price of $0.60/million tokens, that's $55.18.

Of course that's assuming it was just generating flat out all the time - no prefill or anything. That's not likely. Probably much of the time (and tokens) would be in prefill and cache hits. And as you say, DeepSeek v4.1 Flash is a much stronger model than a 35B two generation old Qwen.

So yep, DeepSeek's API is pretty cheap. They're not paying anything like $0.33/kwh for one, and they're able to keep util much higher than you are, and they are subsidizing so they can get more data and code to train on.

If you were paying for Fireworks to host the model in the US with no training and ZDR, it would be $1.80 per million tokens (3x price), so a grand total of $165.56/yr.

I'd argue that at those values, the price difference really doesn't matter one way or the other. What matters is output quality, human time required, privacy, and sovereignty. Also, there's something to be said for (nearly) zero marginal cost reducing the barrier to playing with an idea. If I had to spend $40 to try out an idea over a few million files, I might think about it first. If I could just load it up on my existing server and let it cook overnight, I would not worry about it. Maybe I should consider electricity marginal costs more, but practically I don't really.