Comment by terhechte
14 days ago
I just loaded two models of different quants into LM Studio:
qwen 2.5 coder 1.5b @ q4_k_m: 1.21 GB memory
qwen 2.5 coder 1.5b @ q8: 1.83 GB memory
I always assumed this to be the case (also because of the smaller download sizes) but never really thought about it.
No comments yet
Contribute on Hacker News ↗