Comment by naasking

nvfp4 is pretty good, and with 4 machines you get a roughly 4x speedup using tensor parallelism.