← Back to context Comment by nojs 2 days ago Any idea why it’s so slow? the entire model should fit in the vram of one card. 1 comment nojs Reply graceful6800 1 day ago The NVFP4 quant is completely broken, so I'm not shocked that other quants aren't fully there yet. Give it some time to cook.
graceful6800 1 day ago The NVFP4 quant is completely broken, so I'm not shocked that other quants aren't fully there yet. Give it some time to cook.
The NVFP4 quant is completely broken, so I'm not shocked that other quants aren't fully there yet. Give it some time to cook.