Comment by phoghed
14 hours ago
How does this change that? You could already run open models with vLLM (note models, not just a single model like this release), which many companies do. DeepSeek’s fork of that will surely improve the self hosting landscape, but I don’t see how it it’s some “nuke” or “kamikaze” as the top comments are implying.
Also note that this is not a complete solution for self hosting. I assume that parts of this will be upstreamed to vLLM which this forked a while ago.
No comments yet
Contribute on Hacker News ↗