Comment by shafyy
17 hours ago
Can somebody explain like I'm five what this exactly is? How are providers like Fireworks or Novita providing inference today? Do they use some other inference engine software? If yes, what is the advantage of the DeepSeek inference engine?
For the most part each provider implemented their own inference engines. This release will help them all adopt the common set of optimisations to serve DeepSeek Flash optimally.
Interesting, thanks!
Well except that baseten serves deepseek faster than this already at a lower price. So this seems to mostly help startup inference providers that don't have their own inference engines.