Comment by MeetingsBrowser
9 hours ago
Going from a company with no experience building and operating datacenters to a company with 100B worth of compute is a multi-decade high risk goal.
9 hours ago
Going from a company with no experience building and operating datacenters to a company with 100B worth of compute is a multi-decade high risk goal.
xAI built a datacenter in a few weeks, if I remember correctly.
That’s PR hype. They built it quickly, but they didn’t go from deciding they wanted a data center to having it running in weeks.
You can’t even get the hardware at that scale without months or years of order lead time. NVidia doesn’t have warehouses full of compute hardware waiting for someone to come get it.
They also reused an existing building. Basically, they put 100,000 GPUs into a building and attached the necessary infrastructure in about half a year. Impressive, but it’s not the same as a $10B/year data center usage commitment like this deal.
Why does this matter? The deal is supposed to last 10 years. If you don't pay AWS to order Nvidia GPUs for you, Nvidia won't have to deliver them to AWS, they will have exactly the same quantity of GPUs, but this time they can deliver to you.
1 reply →
And they used illegal power to do it (which will now give local poor people health disorders at 4x the national average). They likely violated every law possible in the process, like OSHA standards, overtime. Musk loves to overwork people.
xAI built the Colossus data center in 122 days (just the physical construction time).
Colossus initially had ~200k GPUs. 100B buys you ~1 million high end GPUs running 24/7 for a year at AWS retail prices.
Initial Colossus buildout was 100K GPUs
They also reused an existing building that happened to be in the right place at the right time. The larger data center buildouts would almost always need new, dedicated construction.