← Back to context Comment by verdverm 3 hours ago curious why the HF pill (on the right) always has inaccurate values 3 comments verdverm Reply bopbop9876 41 minutes ago I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants. stymaar 3 hours ago I noticed the same, and I wonder as well. verdverm 3 hours ago I suspect they are calculating something in the weights or config, I see it pretty consistently with quants
bopbop9876 41 minutes ago I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants.
stymaar 3 hours ago I noticed the same, and I wonder as well. verdverm 3 hours ago I suspect they are calculating something in the weights or config, I see it pretty consistently with quants
verdverm 3 hours ago I suspect they are calculating something in the weights or config, I see it pretty consistently with quants
I believe it's because this model is natively fp8 (for the most part), and that display struggles native quants.
I noticed the same, and I wonder as well.
I suspect they are calculating something in the weights or config, I see it pretty consistently with quants