Comment by ofjcihen
12 hours ago
I mean what’s to argue about really? If the product can do what I need it to do at lower cost and much lower exposure why wouldn’t I use it?
The vast majority of operations don’t need SOTA anyway.
12 hours ago
I mean what’s to argue about really? If the product can do what I need it to do at lower cost and much lower exposure why wouldn’t I use it?
The vast majority of operations don’t need SOTA anyway.
How does this change that? You could already run open models with vLLM (note models, not just a single model like this release), which many companies do. DeepSeek’s fork of that will surely improve the self hosting landscape, but I don’t see how it it’s some “nuke” or “kamikaze” as the top comments are implying.
Also note that this is not a complete solution for self hosting. I assume that parts of this will be upstreamed to vLLM which this forked a while ago.
>The vast majority of operations don’t need SOTA anyway.
I agree. But people rarely pay only for the minimum they need.