← Back to context

Comment by BoredomIsFun

2 days ago

12GiB card not GB. Extra tail compounds to extra 800 MB.

Fair, but the download sizes given above are also in GiB.

Also these calculations are very approximate anyway. The 6.67% difference will not change the fact that 5.8 << 12.

  • No file sizes normally given in raw bytes. I've downloaded dozens of models from huggingface, and the difference was always favouring the VRAM size in GiB.