Comment by thot_experiment
16 hours ago
q6 is fine for that qwen with ctx @ q8, and the dense models of that size are solid at q4 with q8 ctx
16 hours ago
q6 is fine for that qwen with ctx @ q8, and the dense models of that size are solid at q4 with q8 ctx
No comments yet
Contribute on Hacker News ↗