Comment by chao-

There already are SXM5-to-PCIe adapter cards, but from what little I've seen, they are all a bit dodgy. If (if!) there really is some flood of used/decommissioned H100s/H200s into the market, perhaps that will motivate iterations and mass production of these, and they become more reliable?

It is not 100% out of the question. I would also love to see it happen, but am being realistic about the chances, as a check on my own usual optimism.

I think the more likely scenario is, rather than a flood of decommissioned Hopper-era servers being separated into parts, and the parts sold for "pennies on the dollar", we will see entire 4x H100 servers (CPU and RAM included) sold for "dimes on the dollar" to small-and-mid-sized businesses and labs. A formerly-$250K server sold for $50K after six years. Or $20K after ten years. Something like that.