Comment by mdp2021
8 hours ago
> A small model would be [mobile size]
A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?
8 hours ago
> A small model would be [mobile size]
A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?
Is that analogue or are they baking floating points into the silicon?
It's entirely possible they're using something like block floating point, where most of the hardware is simply fixed point. AMD's NPU does this, for example.