← Back to context Comment by hchja 1 day ago This is pretty useless in any case that doesn’t involve BFloat16 models 2 comments hchja Reply spindump8930 1 day ago bf16 is the defacto default datatype and distribution type for LLMs, which are then often eagerly quantized by users with more limited hardware. See the recent Llama releases and e.g. the H100 spec sheet (advertised flops and metrics target bf16). throwaway314155 1 day ago So an increasingly smaller number of cases?
spindump8930 1 day ago bf16 is the defacto default datatype and distribution type for LLMs, which are then often eagerly quantized by users with more limited hardware. See the recent Llama releases and e.g. the H100 spec sheet (advertised flops and metrics target bf16).
bf16 is the defacto default datatype and distribution type for LLMs, which are then often eagerly quantized by users with more limited hardware. See the recent Llama releases and e.g. the H100 spec sheet (advertised flops and metrics target bf16).
So an increasingly smaller number of cases?