Comment by ghostpepper
21 hours ago
which quants of 3.5 vs 3.6 did you compare? I guess you're saying that whatever quant you were using, going one lower was worse? ie. 3.5 Q6_K at 22.5GB versus 3.5 Q6_K at 22.9GB?
21 hours ago
which quants of 3.5 vs 3.6 did you compare? I guess you're saying that whatever quant you were using, going one lower was worse? ie. 3.5 Q6_K at 22.5GB versus 3.5 Q6_K at 22.9GB?
No comments yet
Contribute on Hacker News ↗