Comment by NitpickLawyer
17 hours ago
This is more exciting than k3, IMO. Dsv4 models are extremely cheap to serve. Improving their capabilities has lots of downstream effects, as it becomes "good enough" for more and more tasks.
DS was serving the pro version at extremely low prices for a long time, and they've had integrations with opencode & other providers, so they likely gathered a lot of data from real developers doing real tasks (on openrouter they were labeled as such). Now they can use those live scenarios to further post-train their models and improve them further.
Can't wait to see if distilling k3 into dsv4 brings additional improvements. Anyway, having fast cheap models getting better is great for the community. Especially since these don't "go away" on a provider's whim. Whatever capabilities they get, can be used "forever" going forward. And, at least flash can be ran "at home" with <10k in hardware, which isn't really possible / feasible with glm/k3 larger models.
"Forever" gets the scare quotes because it is implied only up until the Butlerian Jihad?
I upvoted you just for the Dune reference.
I feel like once they make a mega successful movie of a book we can stop doing the secret handshake.
4 replies →
distilling K3 into DS4 flash will likely only be a good idea for specialists. the difference in model capacity is otherwise too large.
we used to distill GLM 5.2 into Qwen 27B specialists with great success.
developing the workflows is tricky though. we had the advantage of a straightforward mapping function in mind: English -> SQL which was relatively easy to pipeline training for.
Totally! This with DwarfStar delivers usable local AI (I hope!)
Usable local AI has been here for a while, esp on say a 5090.
You can’t treat Qwen3.6 like its fable, but if you prompt precisely and specifically it’s a great executor.
I actually found it refreshing to use more of my brain for once, and actually have to think deeper about what I’m trying to do, and how to build it.
Parent is referring to https://github.com/antirez/ds4
What are your goalposts? Depending on your requirements, there have been many moments of usable local AI. More recent ones were gpt-oss 120b and Qwen 3.6 27b.
Starting to wonder if the free big pickle model on opencode has been DSV4F0731 for the past few months. It’s been incredibly fast and good.
At least in the past it was GLM-4.6. IDK if it is ever changed.
https://github.com/anomalyco/opencode/issues/4276
I’ve heard that too, but since it’s a stealth model, I suspect they change it to whatever preview model provider that offers a free endpoint. In the past few months, I’ve gotten 4xx errors identifying the provider as DeepSeek.
hope that deepseek become better
Have you tried the one that was just released?