Comment by zackangelo

7 days ago

I don't believe safetensors has a native int4 dtype, so they packed 4 int4s into a bf16 in this checkpoint.

0 comments