Comment by lm28469
4 hours ago
We're talking past each other I think. In theory we can cool down anything we want, that's not the problem. 8 DGX B200 isn't a datacenter, and certainly not anywhere close to the figures discussed (500-1000tw of ai satellites per year)
Nobody said sending a single rack and cooling it is technically impossible. We're saying sending datacenters worth of rack is insanely complex and most likely not financially viable nor currently possible.
Microsoft just built a datacenter with 4600 racks of GB300, that's 4600 * 1.5t, that alone weights more than everything we sent into orbit in 2025, and that's without power nor cooling. And we're still far from a single terawatt.
it is instructive to calculate the size and requirements for a system that can pretrain a 405B parameter transformer in ~ 17 days.
a different question is the expected payback time, unless someone can demonstrate a reasonable calculation that shows a sufficiently short payback period, if no one here can we still can't exclude big tech seeing something we don't have access to (the launch costs charged to third parties may be different than the launch costs charged for themselves for example).
suppose the payback time is in fact sufficiently short or commercial life sufficiently long to make sense, then the scale didn't really matter, it just means sending up the system described above repeatedly.
I mean yeah if you consider the "scale" to not be a problem there are no problems indeed. I argue that the scale actually is the biggest problem here... which is the case with most of our issues (energy, pollution, cooling, heating, &c.)
The real question is not scale, but if it makes financial sense, I don't have sufficient insight into the answer to that question.
Either it does or it doesn't make financial sense, and if it does the scale isn't the issue (well until we run into material shortages building Elon's Dyson sphere, hah).