Comment by UncleOxidant
13 hours ago
Is anyone going to seriously use a model this small for coding? Doesn't seem like the intended use case or strength of these models.
13 hours ago
Is anyone going to seriously use a model this small for coding? Doesn't seem like the intended use case or strength of these models.
definitely would not recommend using it for SWE-style tasks. But chaining a couple bash calls together to find a file? no problem
Agreed not, but I think we are also moving towards a place where harnesses have code mode built in and where data swizelling and tool use is something the LLMs have to be competent at. I think that's present enough here!
And to beat Qwen3.5-4B with such a capable model is amazing, on top of so many win/draws against 9b in the more general arena.
I can definitely see there being some roles for local agents that offload shell scripting & doing some scut work. I don't know what speed to expect but like, if someone has a decent NPU or GPU and can just get a bunch of basic systems work done with a small local model that could really speed up a lot of workflows that I see day after day after day.