Comment by ricardobayes
1 day ago
This is the first Qwen fine-tune that is not immediately rejected by the local LLM community, and in some cases even being recommended. Based on my limited usage, it is good, gives creative solutions to coding problems. I don't expect 9-35B models to one-click create full apps. Most people who were complaining did so .
The local LLM community is now teeming with erstwhile crypto and NFT hucksters who've brought the culture of hype from their former communities with them. There still are a few deeply technical people left, but their voices are being crowded out by the vapid marketers'.
/r/localllama is not like that at all.
I've also noticed this. I wonder what causes the overlap. It can't be as simple as crypto and LLMs requiring the same hardware.
They both feed off of hype. The people posting about crypto are not the same people gpu mining crypto so I wouldn’t chalk it up to the same hardware
Money.
There are certain influential people on Twitter, who if you see them start tweeting on a subject, you know the influx of hype and hucksters is coming.
coughKarpathycough
> Most people who were complaining did so .
It has been this way since the beginning, unfortunately. There is certainly no harm in trying on local models on local workloads with modest guardrails.
Like most of these models (Qwen, Gemma, Llama, gpt-oss), finding all the little gotchas like, special tokens and prompt structure, model preference are a PITA right now. The reward are really nice models that run exceptionally well in agentic harnesses tuned with the prompts and parameters you fought so hard to learn.
Its not any better. Most of us at LocalLLama community dont like it except a few new people poping out and making posts.
Indeed, it performed worse than Qwen3.6-27b in my basic test.
It gave a fancier looking answer, but did a worse job following the prompt.
Roughly my experience so far; it trips up on itself a bit.
However, it's much more inclined to do web search unprompted, which is fascinating in its own way.
> LocalLLama community
Ah, the place that shit on gpt-oss because it wasn't good at porn. That place is not what it used to be, hasn't been since that karpathy tweet, tbh. It's mostly slop and vibes nowadays.
and a lot of bots advertising a rename models like this one.
Where’s a good place to go instead nowdays?
We must be in different communities... Qwen models are the most recommended ones that will actually run on local hardware that is accessible to the masses!
Yeah, but they're talking about fine-tunes.