Comment by Archit3ch 17 hours ago What's the verdict for real world use on Q3 120B (fits in 64GB) vs Q4 of a smaller model? 1 comment Archit3ch Reply FuckButtons 10 hours ago Bigger model wins as long as the quantization was done properly.
Bigger model wins as long as the quantization was done properly.