Apparently the ud-q4_k_xl version of qwen 3.8 27b is quite better than the q3 and not much larger. At least per r/localllama. (I'm also trying to find a good local model).
Thanks, I haven't used the gemma models in a while. Last I remembered, their small models weren't bad but obviously showed signs of being "small". (Funnily irl I use Gemini 3.1 pro more than all other models combined).
Apparently the ud-q4_k_xl version of qwen 3.8 27b is quite better than the q3 and not much larger. At least per r/localllama. (I'm also trying to find a good local model).
Thank you, will give it a try. To be honest only gemma 4s do well in my re test.
Thanks, I haven't used the gemma models in a while. Last I remembered, their small models weren't bad but obviously showed signs of being "small". (Funnily irl I use Gemini 3.1 pro more than all other models combined).
Here's the link btw (also for my own reference):
https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/blob/main/Qw...