Comment by kiproping
3 hours ago
From a cursory glance on huggingface, the files don't add up to 2+TB. Unless it adds up to that when you extract the multiple ~17GB files, if that's the case then that's some crazy compression.
3 hours ago
From a cursory glance on huggingface, the files don't add up to 2+TB. Unless it adds up to that when you extract the multiple ~17GB files, if that's the case then that's some crazy compression.
If it's 4-bit native for the sparse parameters (which is the bulk of them) why would you expect it to add up to 2+TB?