Comment by dom96
5 hours ago
For what it's worth, it does perform on par with DeepSeek V4 Pro on my adversarial programming language benchmark[1]. I wouldn't think they would benchmax on that.
5 hours ago
For what it's worth, it does perform on par with DeepSeek V4 Pro on my adversarial programming language benchmark[1]. I wouldn't think they would benchmax on that.
Any chance you could try qwen3.8 flash next? That is currently the best local model for actual coding tasks in my + many coworkers experience. It will run reasonably fast if you have 64+ gb ram and use strata or a strata fork (vram not super important with this method).
https://github.com/Niko1221/Strata
We need many more niche, edge-case-y benchmarks like this
what a bizarre benchmark, cool!