Comment by Roritharr
8 hours ago
That’s not exactly true, a lot of GPUs are sitting in warehouses because they are lacking prerequisites to being installed, in some cases this is even just power.
https://www.tomshardware.com/tech-industry/data-centers-in-n...
I don’t think the article you cite supports your point with confidence you convey. Yes other dimensions can complicate deployment, but incentives to work around those issues are high, given the cost of GPUs
That’s not the same. Those GPUs are allocated to real projects with real demand. If they could turn them on today they would do it and they would have customers.
It’s not the same as dark fiber capacity being overbuilt for demand that wasn’t there yet.
> If they could turn them on today they would do it and they would have customers.
Is this really true? Other than the occasional outages, the frontier labs don't seem to be getting overloaded by API pricing customers at peak times, and with Opus 5.5 using even less tokens (which translates into less GPU time and less money spent on the same tasks), it seems actual capacity isn't literally strained right now. If current needs are met by currently available capacity, where is this demand going to come from?
There appear to be a lot of uninstalled GB200s (looking at you Azure), but the power efficiency of those is ~10x worse than a Vera Rubin. Does it really make sense to install them, when your data center is power/cooling limited, and it's not built yet?
Maybe somebody will use them, but not the original owners.
Yes. I have 3 GPUs in the other room, sitting in boxes, waiting to be powered on, because I dont have the electrical circuit installed in the room yet.
I can directly confirm this fact, and I'm just some random dude out here in suburbia, who can only imagine what the Indiana Jones warehouse of glowing GPUs looks like in a data center.
We're all salivating over this imagined future where an AI toilet seat greets us every morning.
Who here has already asked AI how to make your own DRAM ? I know you have. Thats a sign of peak interest in a subject or market.
> We're all salivating over this imagined future where an AI toilet seat greets us every morning.
I'm not, but I can certainly believe the surveillance industry vectoralists are salivating over a future where their AI toilet seats greet each of their data subjects every morning.
If only AI had been watching Epsteins toilet, then we would all finally know what happened to that turd. :D
… and cooling