Comment by yassa9 5 months ago what quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enough 1 comment yassa9 Reply sgt101 4 months ago 8bits is fine.... I was talking full bore.
8bits is fine.... I was talking full bore.