Comment by eblanshey

2 days ago

I see. Did you see any intelligence degradation between FP8 and NVFP4 for 3.6 27B? You're using vLLM, right?

0 comments