Comment by zargon
10 hours ago
> ~100GB at 16 bit or ~50GB at 8bit quantized.
V4 is natively mixed FP4 and FP8, so significantly less than that. 50 GB max unquantized.
10 hours ago
> ~100GB at 16 bit or ~50GB at 8bit quantized.
V4 is natively mixed FP4 and FP8, so significantly less than that. 50 GB max unquantized.
No comments yet
Contribute on Hacker News ↗