Comment by tgtweak 3 hours ago Citing full precision benchmarks then just going with 4 bit quants 1 comment tgtweak Reply IsTom 35 minutes ago It's natively Q4.
It's natively Q4.