Comment by Robotbeat

Terrestrial data centers are having a hard time connecting to power. What’s the good of a $40/Watt compute asset you can’t turn on? Spending $10 or even $20/Watt extra to get power by sending inference load to orbit starts to sound like a bargain, and that’s doable with today’s launch vehicles. With high reuse, that number drops to below $1/Watt for 24/7 power, which makes it cheaper than any terrestrial energy source. And the vast majority of compute load is inference. Part of the training process benefits from a large, coherent (ie low latency) data center, but that’s a minority of the load nowadays.

Also: low Earth orbit is already pretty low latency. A lot of people’s intuitions about space latency are from when satellite internet was based out of distant geosynchronous satellites, but even that is probably just fine for most inference workloads.