Comment by fc417fc802

10 days ago

It's just an educated guess, but I expect that power density has gone up quite a bit as a form of optimization. Efficiency gains permit both lower power (mobile) and higher compute (server) parts. How tightly you pack those server parts in is an entirely different matter. How many H100s can you fit on average per 1U of space?