Comment by wolttam 2 days ago Hopefully you also bought a switch 3 comments wolttam Reply whalesalad 2 days ago they have 2 interfaces each so you typically daisy chain them wolttam 2 days ago That will hurt latency and latency is very important for good tensor-parallelism performance mmastrac 2 days ago I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.
whalesalad 2 days ago they have 2 interfaces each so you typically daisy chain them wolttam 2 days ago That will hurt latency and latency is very important for good tensor-parallelism performance mmastrac 2 days ago I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.
wolttam 2 days ago That will hurt latency and latency is very important for good tensor-parallelism performance mmastrac 2 days ago I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.
mmastrac 2 days ago I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.
they have 2 interfaces each so you typically daisy chain them
That will hurt latency and latency is very important for good tensor-parallelism performance
I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.