Comment by xnx
1 year ago
Definitely the right way to look at things.
> If you take the "350,000" H100s that Facebook wants by EOY, each of those can do 700W
Plus ~500W for cooling
1 year ago
Definitely the right way to look at things.
> If you take the "350,000" H100s that Facebook wants by EOY, each of those can do 700W
Plus ~500W for cooling
Less than a 1:1 ratio here is an extremely efficient datacenter. The heat has to get out of the building, not just off the chip.
Oh, wow. I didn't know it was that bad. Google advertises a PUE of 1.1: https://www.google.com/about/datacenters/efficiency/
Just to clarify, PUE of 1.1 means 10% power waste not spent on computing. However, Google datacenters are extremely efficient, and they design everything end-to-end for efficiency. A normal datacenter with less efficient cooling, less efficient power delivery, less efficient buildings, etc. easily adds up to a lot more wasted power.