← Back to context

Comment by phoghed

12 hours ago

How does this change that? You could already run open models with vLLM (note models, not just a single model like this release), which many companies do. DeepSeek’s fork of that will surely improve the self hosting landscape, but I don’t see how it it’s some “nuke” or “kamikaze” as the top comments are implying.

Also note that this is not a complete solution for self hosting. I assume that parts of this will be upstreamed to vLLM which this forked a while ago.