Comment by selcuka
1 day ago
Fair, but the download sizes given above are also in GiB.
Also these calculations are very approximate anyway. The 6.67% difference will not change the fact that 5.8 << 12.
1 day ago
Fair, but the download sizes given above are also in GiB.
Also these calculations are very approximate anyway. The 6.67% difference will not change the fact that 5.8 << 12.
No file sizes normally given in raw bytes. I've downloaded dozens of models from huggingface, and the difference was always favouring the VRAM size in GiB.