Comment by acchow
13 days ago
> Q4_K_M has ~0 quality degradation
Llama 3.3 already shows a degradation from Q5 to Q4.
As compression improves over the years, the effects of even Q5 quantization will begin to appear
13 days ago
> Q4_K_M has ~0 quality degradation
Llama 3.3 already shows a degradation from Q5 to Q4.
As compression improves over the years, the effects of even Q5 quantization will begin to appear
No comments yet
Contribute on Hacker News ↗