← Back to context Comment by verdverm 4 hours ago curious why the HF pill (on the right) always has inaccurate values 3 comments verdverm Reply bopbop9876 2 hours ago I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants. stymaar 4 hours ago I noticed the same, and I wonder as well. verdverm 4 hours ago I suspect they are calculating something in the weights or config, I see it pretty consistently with quants
bopbop9876 2 hours ago I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants.
stymaar 4 hours ago I noticed the same, and I wonder as well. verdverm 4 hours ago I suspect they are calculating something in the weights or config, I see it pretty consistently with quants
verdverm 4 hours ago I suspect they are calculating something in the weights or config, I see it pretty consistently with quants
I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants.
I noticed the same, and I wonder as well.
I suspect they are calculating something in the weights or config, I see it pretty consistently with quants