Comment by Spooky23 2 months ago A base Mac Mini is ~20 :) 1 comment Spooky23 Reply pclmulqdq 2 months ago Oh yeah, I did that math not assuming any quantization. I think if you can get a 3-4 bit quant working + int8 math, ~80 might be achievable.
pclmulqdq 2 months ago Oh yeah, I did that math not assuming any quantization. I think if you can get a 3-4 bit quant working + int8 math, ~80 might be achievable.
Oh yeah, I did that math not assuming any quantization. I think if you can get a 3-4 bit quant working + int8 math, ~80 might be achievable.