Comment by villish
7 days ago
It would run so slow it would be functionally unusable or at such a low quant that it wouldn't be useful for serious work.
7 days ago
It would run so slow it would be functionally unusable or at such a low quant that it wouldn't be useful for serious work.
nvfp4 is pretty good, and with 4 machines you get a roughly 4x speedup using tensor parallelism.