Comment by namegulf 10 hours ago Is there a Quantized version of this? 1 comment namegulf Reply mordae 7 hours ago They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these.
mordae 7 hours ago They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these.
They have released mixed fp8/fp4 for efficiency. It's still hundreds of gigabytes, though. Give up on local for these.