Comment by runtime_terror
12 hours ago
Anecdotal but I was doing regular adversarial reviews of new work using about 5 models (mostly the open Chinese ones like DS, GLM, Qwen, Kimi, etc) and GLM routinely took much longer for similar results and the same instructions.
It would just loop on things and go down rabbit holes more. DS flash has been so consistently good I've kinda settled on it for 90% of my work.
I still use adversarial review for bigger changes where I want to make sure any issues are caught early, but I genuinely feel as tho if no new models ever get made I'd be fine with just using DS forever.
What quant were you using? I’ve been using Q4_K_S for a while now and it’s been rock solid, but having tried Q3_XS, that would loop like crazy. Maybe try a bigger quantity size?