Comment by ilaksh
1 day ago
Try Qwen 3.8 27b or the antirez ds4 0731 quants
Can run on MacBook m5 or new m5 studio or m5 studio ultra or rtx 6000 pro.
1 day ago
Try Qwen 3.8 27b or the antirez ds4 0731 quants
Can run on MacBook m5 or new m5 studio or m5 studio ultra or rtx 6000 pro.
I have it on my 7900xtx but haven't compared it just yet. I might though. Honestly what I need is a lack of knowledge trained into the model. Maybe 27b will be better. I need it to want ground truth data, not hallucinate based on quantized distilled documents from training.