Comment by meander_water

8 hours ago

I would have liked to see quality results between the different quantization methods - Q4_K_M, Q_8_0, Q_6_K rather than tok/s

0 comments