Comment by jauntywundrkind

I'm surprised the interconnect per system is so slow? 6x 200Gb feels barely competitive. Same as last year.

Trainium3 and Maia 200 are 2.5 and 2.8Tb/s vs this 1.2Tb/s. Maia is 6 stacks of HBMe3, so ratio of mem:interconnect bandwidth is really falling behind here. Notably Maia is also, like TPU, high radix.