Comment by pettijohn
18 hours ago
35B MoE is certainly a good and fast local model. I find 27B dense to be quite a bit smarter, so I daily drive that. I wish there was a ~100B MoE with maybe 10B active. It would be super smart and fast!
18 hours ago
35B MoE is certainly a good and fast local model. I find 27B dense to be quite a bit smarter, so I daily drive that. I wish there was a ~100B MoE with maybe 10B active. It would be super smart and fast!
There was a 3.5 122B 10A release -
https://huggingface.co/Qwen/Qwen3.5-122B-A10B
I tried it for a bit, and It was not really worth its size. It got swept up in all the other AI news recently, but laguna s 2.1 I think is the best ~100B moe model right now
I didn't mention it above, but Laguna S is my other favorite model. I use Qwen a lot more, it's smaller and faster, but I like to switch to Laguna when I feel like I need a "heavy hitter" for certain huge or complex tasks.
23 replies →
I agree. 27b dense really did seem like the sweet spot.
A 35 A3B as smart as previous gen 27B would be a sweet point
> 35B MoE is certainly a good and fast local model. I find 27B dense to be quite a bit smarter
Isn't that just the definition of MoE vs dense ?
Full name is 35B-A3B. 3B Is the token generator thats selected out of the 35b available in the model, which is some layered jazz.
So it can be dumber but its quite capablr.
I use 27B in plan mode and 35B MoE in act mode. I noticed that is the best balance for me for consistent tool calls and intelligent planning. Takes some time to switch, but it's worth it for me.
Wonder if it's possible to share a common cache via cachyllama between 27B and 35B-A3B
I've heard 27B is smarter! I tried it some time ago but couldn't get it working with my oMLX. I need to try it again.
Honestly the 27b dense one punches way above its weight in a lot of domains, especially coding in my testing, so I think you will probably be disappointed.
In my case I would say they are comparable but moe models are looping and getting lost a lot more than dense models.
On the other hand having 90t/s with any local model is nice and Pi with loop police extension can prevent looping a lot.
Looping seems related to quantization and not the model itself. If youre digging deep into quants to get working context then yeah.