Comment by monster_truck
20 hours ago
I'm not sure that anyone is running production workloads against an API that bills twice as much for a chunk of the day. One of the best things about Deepseek is that you can host it yourself and get a ridiculous multiple of usage for what the same dollar amount would yield from their API
> I'm not sure that anyone is running production workloads against an API that bills twice as much for a chunk of the day.
I'm not sure that anyone will mind running production workloads against an API that bills half as much for a chunk of the day.
It'd be very expensive to get a setup that can run non-flash well.
If they were still at original price I'd get a couple of DGX Sparks myself to run Flash models at a decent quant/context combo.