Comment by cmrdporcupine
2 days ago
Devstral Small 24b looks promising as something I want to try fine tuning on DSLs, etc. and then embedding in tooling.
2 days ago
Devstral Small 24b looks promising as something I want to try fine tuning on DSLs, etc. and then embedding in tooling.
I haven't tried it yet, but yes. Qwen3 Next 80B works decently in my testing, and fast. I had mixed results with the new Nemotron, but it and the new Qwen models are both very fast to run.
Same experience: on my old M2 Mac with just 32B of memory both Qwen 3 30B and the new Nemotron models are very useful for coding if I prepare a one-shot prompt with directions and relevant code. I don’t like them for agentic coding tools. I have mentioned this elsewhere: it is deeply satisfying to mix local model use with commercial APIs and services.