Comment by graceful6800

2 days ago

The NVFP4 quant is completely broken, so I'm not shocked that other quants aren't fully there yet. Give it some time to cook.

0 comments