Comment by menaerus
5 hours ago
I wonder what the target audience for this price range is? At that price point I would rather go for a single H100.
5 hours ago
I wonder what the target audience for this price range is? At that price point I would rather go for a single H100.
I would rather take this option than a single H100:
> 96 GB Dual NVIDIA RTX PRO 5000 w/ 1000W PSU (non-refundable) +$19,169
Though I don't think there's anything stopping you from trying to stuff an H100 into this machine if you want to BYO.
For that price you get the H100. The machine is overpriced, and I'd personally rather go for a second-hand workstation with server-grade components.
Hopper is ~4 years old at this point though, compared to Blackwell which is ~2 years old, the difference isn't nil.
Depending on your use case, you might prefer native FP4 and FP6 low-precision support and 5th-generation Tensor Cores rather than what Hopper offers.
I think for training Hopper makes sense as it's generally a bit cheaper and the difference isn't that big, but for inference the difference widens a bunch makes a lot more sense to go with Blackwell.