Comment by ryno364
13 hours ago
This is really cool. But, from what I can tell, its not a huge game changer. Anyone was able to run the open weights model locally anyway. This is just higher performance.
Unless someone disagrees.
13 hours ago
This is really cool. But, from what I can tell, its not a huge game changer. Anyone was able to run the open weights model locally anyway. This is just higher performance.
Unless someone disagrees.
> This is just higher performance.
More performance from the same hardware means better margins. Deepseek just gave every third-party inference provider a more efficient stack for free. They also get the whole provider community working with them to make inference even more efficient.
This is not about merely running it for demo purposes; it’s about running things in production for generating actual value.
?
Inference is super easy, you already have a myriad libraries that accomplish this. In fact if you read the source, this is release is mostly a wrapper around those same libs.
its the difference between hosting a video from your home computer and running netflix