I'm surprised the interconnect per system is so slow? 6x 200Gb feels barely competitive. Same as last year.
Trainium3 and Maia 200 are 2.5 and 2.8Tb/s vs this 1.2Tb/s. Maia is 6 stacks of HBMe3, so ratio of mem:interconnect bandwidth is really falling behind here. Notably Maia is also, like TPU, high radix.
Thanks. Yeah uhhh the table here says 19.2Tb/s scale up per chip??? Uhhhhhhhh. This math is still not mathing for me. But that makes much much more sense.
Google just wildly ahead of literally everyone here.
19.2Tb is 2 x 9.6Tbps. Some (most) companies count Tx and Rx separately despite it making no sense in the context of serdes lanes. Stupid marketing in my opinion.
I don't think they are meaningfully ahead, it's more to do with what's available at the time. 200/224G is only just coming available this year. The others will have the same in their next product announcements.
Thanks again. Very PS, rad to see you putting commits into mopidy still. I haven't touched mpd like systems in a decade but they have a fond place in my heart!!
Trainium3 and Maia 200 are 2.5 and 2.8Tb/s vs this 1.2Tb/s. Maia is 6 stacks of HBMe3, so ratio of mem:interconnect bandwidth is really falling behind here. Notably Maia is also, like TPU, high radix.