Comment by cavisne 3 months ago The H100 theoretical flops number is just marketing, as it relies on sparsity that LLMs don’t use 1 comment cavisne Reply az226 3 months ago And the practical flops always end up lower. As an example a V100 has 125 according to spec, but the ideal case is more like 100 and non-ideal like 60.
az226 3 months ago And the practical flops always end up lower. As an example a V100 has 125 according to spec, but the ideal case is more like 100 and non-ideal like 60.
And the practical flops always end up lower. As an example a V100 has 125 according to spec, but the ideal case is more like 100 and non-ideal like 60.