Comment by rybosworld
10 hours ago
> The basic math is that launching a million tons per year of satellites generating 100 kW of compute power per ton would add 100 gigawatts of AI compute capacity annually, with no ongoing operational or maintenance needs. Ultimately, there is a path to launching 1 TW/year from Earth.
> My estimate is that within 2 to 3 years, the lowest cost way to generate AI compute will be in space.
This is so obviously false. For one thing, in what fantasy world would the ongoing operational and maintenance needs be 0?
You operate them like Microsoft's submerged data center project: you don't do maintenance, whatever fails fails. You start with enough redundancy in critical components like power and networking and accept that compute resources will slowly decrease as nodes fail
No operational needs is obviously ... simplified. You still need to manage downlink capacity, station keeping, collision avoidance, etc. But for a large constellation the per-satellite cost of that would be pretty small.
How do you make a small fortune? Start with a big one.
The thing being called obvious here is that the maintenance you have to do on earth is vastly cheaper than the overspeccing you need to do in space (otherwise we would overspec on earth). That's before even considering the harsh radiation environment and the incredible cost to put even a single pound into low earth orbit.
If you think the primary source of electricity is solar (which clearly Musk does), then space increases the amount of compute per solar cell by ~5x, and eliminates the relatively large battery required for 24/7 operation. The thermal radiators and radiation effects are manageable.
The basic idea of putting compute in space to avoid inefficient power beaming goes back to NASA in the 60s, but the problem was always the high cost to orbit. Clearly Musk expects Starship will change that.
3 replies →
How much maintenance do you need? Lets say you have hardware whose useful lifespan due to obsolescence is 5 years, and in 4, the satellite will crash into the atmosphere anyways.
Let's say given component failure rates, you can expect for 20% of the GPUs to fail in that time. I'd say that's acceptable.
2 replies →
The idea here is that the economics of launch are changing with Starship such that the "incredible cost" and "overspeccing" of space will become much less relevant. There's a world where, because the cost per kg is so low, a data center satellite's compute payload is just the same hardware you'd put in a terrestrial rack, and the satellite bus itself is mass-produced to not-particularly-challenging specs. And they don't have to last 30 years, just 4-ish, when the computer is ready for retirement anyway.
Will that come to be? I'm skeptical, especially within the next several years. Starship would have to perform perfectly, and a lot of other assumptions hold, to make this make sense. But that's the idea.
If you ramp up the economies of scale to make those things - radiation protection and cost per pound - the calculus changes. It's supposed to synergize with Starship, and immediately take advantage of the reduced cost per pound.
If the cost per pound, power, regulatory burden, networking, and radiation shielding can be gamed out, as well as the thousand other technically difficult and probably expensive problems that can crop up, they have to sum to less than the effective cost of running that same datacenter here on earth. It's interesting that it doesn't play into Jevon's paradox the way it might otherwise - there's a reduction in power consumption planetside, if compute gets moved to space, but no equivalent expansion since the resource isn't transferable.
I think some sort of space junk recycling would be necessary, especially at the terawatt scale being proposed - at some point vaporizing a bunch of arbitrary high temperature chemistry in the upper atmosphere isn't likely to be conducive to human well-being. Copper and aluminum and gold and so on are also probably worth recovering over allowing to be vaporized. With that much infrastructure in space, you start looking at recycling, manufacturing, collection in order to do cost reductions, so maybe part of the intent is to push into off-planet manufacturing and resource logistics?
The whole thing's fascinating - if it works, that's a lot of compute. If it doesn't work, that's a lot of very expensive compute and shooting stars.
4 replies →
Note how Musk cleverly doesn't claim that not doing maintenance drives down costs.
Nothing in there is a lie, but any substance is at best implied. Yes, 1,000,000 tons/year * 100kW/ton is 100GW. Yes, there would be no maintenance and negligible operational cost. Yes, there is some path to launching 1TW/year (whether that path is realistic isn't mentioned, neither what a realistic timeline would be). And then without providing any rationale Elon states his estimate that the cheapest way to do AI compute will be in space in a couple years. Elon is famously bad at estimating, so we can also assume that this is his honest belief. That makes a chain of obviously true statements (or close to true, in the case of operating costs), but none of them actually tell us that this will be cheap or economically attractive. And all of them are complete non-sequiturs.
Elon might have a scoop on getting things to orbit cheaper than everyone else.
Unless I missed something the Microsoft underwater data center was basically a publicity stunt.
Anyone who thinks it makes sense to blast data centers into space has never seen how big and heavy they are, or thought about their immense power consumption, much less the challenge of radiating away that much waste heat into space.
Radiation is an even bigger problem, especially in the polar orbits they are talking about.
1 reply →
I don't think it was a stunt. It was an experiment.
I think passive cooling (running hot) reduced some of the advantages of undersea compute.
I was listening to a Darknet Diaries episode where Maxie Reynolds seems to make it work: https://subseacloud.com/ I don't know how profitable they are, and I doubt this is scalable enough, but it can work as a business.
Ironically a benefit of underwater datacenters would be reduced cosmic rays. Not so great in orbit, I imagine!
What about a data centre only running SQLite?
Well the thing is that it seemed to have been successful beyond all expectations despite being that? They had fewer failures due to the controlled atmosphere, great cooling that took no extra power, and low latency due to being close to offshore backbones. And I presume you don't really need to pay for the land you're using cause it's not really on land. Can one buy water?
Space is pretty ridicolous, but underwater might genuinely be a good fit in certain areas.
5 replies →
An 8 GPU B200 cluster goes for about $500k right now. You'd need to put thousands of those into space to mimic a ground-based data center. And the launch costs are best case around 10x the cost of the cluster itself.
Letting them burn up in the atmosphere every time there's an issue does not sound sustainable.
A Falcon Heavy takes about 63 tons to LEO, at a cost of about $1,500 per kg. A server with 4x H200s and some RAM and CPU costs about $200k, and weighs about 60kg, with all the cooling gear and thick metal. As is, it would cost $90k to get to LEO, half of the cost of the hardware itself.
I suppose that an orbit-ready server is going to cost more, and weigh less.
The water that serves as the coolant will weigh a lot though, but it can double as a radiation shield, and partly as reaction mass for orbital correction and deorbiting.
2 replies →
Are launch costs really 10x!? Could I get a source for that?
In the back on my head this all seemed astronomically far-fetched, but 5.5 million to get 8 GPUs in space... wild. That isn't even a single TB of VRAM.
Are you maybe factoring in the cost to powering them in space in that 5 million?
2 replies →
Playing devil's advocate, when a GPU dies you don't typically fix it, right? You just replace it.
What if you could keep them in space long enough that by the time they burn up in the atmosphere, there are newer and better GPUs anyway?
Still doesn't seem sustainable to me given launch costs and stuff (hence devil's advocate), but I can sort of see the case if I squint?
Let me rip my bong real quick..
What if you had a fleet of Optimus robots up there who would actually operate a TSMC in space and they would maintain the data centers in space?
Hold on let me enter a K hole…
What if we just did things?
1 reply →
You mean you operate them like Microsoft's failed submerged data center project [1]. When pointing at validating past examples you are generally supposed to point at successes.
[1] https://en.wikipedia.org/wiki/Project_Natick
The opposite of down is up, so it wouldn't be completely illogical.
Did we read the same Wikipedia page? It doesn't say the word "failed" anywhere on it.
1 reply →
But if we’re going down that line of thinking then it’s a poor comparison. I could open a data centre on the ground and use the same principle of zero maintenance, and it would be way cheaper and way more powerful.
But you could just run a “zero maintenance” data center on Earth and not pay to blast it into orbit.
How many submerged datacenters is Microsoft operating?
None, https://www.datacenterdynamics.com/en/news/microsoft-confirm...
Zero.
You also have to get rid of waste heat :P
This will totally work since we have an unlimited amount of rare earth elements we can just ship off into space never to see again. Infinite raw materials + infinite power equals infinite AI!!!
The financial system is already freaking out about depreciation on land based data centers. I don't think it could survive what you're talking about.
Accountants love this
Being under the ocean in a metal box you don't get too many micro-meteors or cosmic rays though.
...and costs pennies compared to putting anything up there, so it can even enjoy those cosmic goodies.
Just like you don’t get much water in space.
1 reply →
As soon as a statement contains a timeframe estimate by Musk you know to disregard it entirely.
The thing is: at the end of the day, SpaceX takes the "impossible" and makes it "late".
People are going to Tory Bruno the space datacenters until one day their Claude agent swarm's gonna run in space and they'll be wondering "how did we get here"?
The thing is: at the end of the day, making absolute statements about the inevitability of future success is a fool’s errand.
Musk has a documented history of failing to deliver on promises, timescale or no. So it’s best to engage in some actual critical thinking about the claims he is making.
napkin math says sq kms of radiators to cool 100MW, it's just patently ridiculous
1 reply →
Or takes the impossible and puts a half baked version of it behind a $99/ month paywall.
1 reply →
There's clearly rhetorical hyperbole happening there. But assuming that thermal rejection is good in space, & launch costs continue falling, as earth-based data centers become power/grid-constrained, there is a viable path for space power gen.
The craziest part of those statements is "100 kW per ton." IDK what math he is doing there or future assumptions, but today we can't even sniff at 10 kW per ton. iROSA [1] on the ISS is about 0.150 kW per ton.
[1]https://en.wikipedia.org/wiki/Roll_Out_Solar_Array
edit: iROSA = 33 kW per ton, thanks friends
Not to be an Elon defender, but can you back up your 0.15/ton? My own searching puts ROSA orders of magnitude higher. Each array is 600kg (0.6t) and puts out 20kw (https://space.skyrocket.de/doc_sdat/irosa-1.htm) which makes 20/0.6 = 33.333 kw/ton
You're right, my fault. I made an math booboo somewhere. Your calc seems right
1 reply →
The company lists their ISS solar panels as 28 kW for 331 kg, which comes pretty near to 100 W/kg.
Company website:
https://rdw.com/wp-content/uploads/2023/06/redwire-roll-out-...
And their Opal configuration beats the metric: 5.3 kW for 42.7 kg.
Okay so that works out to 124 kW/ton for the opal config.
Maybe I'm just out of the loop, but is solar substantially more efficient in space? I assume the satellites won't orbit in a way that follows the sun. And presumably the arrays of panels they can attach to a satellite don't exceed the size of the panels you could slap on and around a data center (at least without being insanely expensive).
Yeah the main benefits are:
1. solar is very efficient at generating energy, no moving parts, simple physics etc.
2. in space you don't deal with weather or daylight cycle, you can just point your panels at the sun and generate very stable energy, no batteries required
3. environmental factors are simpler, no earthquakes, security, weather. Main problem here is radiation
In theory its a very elegant way to convert energy to compute.
2 replies →
> But assuming that thermal rejection is good in space
Don't assume this. Why would you assume this?
Just put a slightly larger solar array on the same equipment on earth?
> put a slightly larger solar array on the same equipment on earth?
Land and permitting. I’m not saying the math works. Just that there are envelopes for it to.
6 replies →
Solar in space is a very different energy source in terms of required infrastructure. You don't need batteries, the efficiency is much higher, cooling scales with surface area (radiative cooling doesn't work as well through an atmosphere vs. vacuum), no weather/day cycles. Its a very elegant idea if someone can get it working.
2 replies →
Sun-synchronous orbit means there's no nightime for satellites in that orbit.
"There's clearly rhetorical hyperbole happening there" in a business paper is called lying
Name a unicorn whose early round pitch decks are 100% free of wishful thinking
Elon is a pathological liar and it’s crazy that he still gets sanewashed after all he’s done. It’s insanity that he hasn’t been kicked out of leading his companies, and it’s also insanity that he hasn’t been prosecuted by the SEC.
You’ve spent too much life force trying to even understand the liar’s fake logic.
Let’s start right here: there is no such thing as becoming power/grid constrained on earth. If you replaced just the cornfields that the United States uses just to grow corn for ethanol in gasoline just in the corn belt, you could power the entire country with solar+batteries+wind. Easily, and cheaply.
If you don’t even believe that solar+batteries are cheap (they are), fine, choose your choice of power plant. Nuclear works fine.
The truth is, xAI combining with SpaceX is almost certainly corrupt financial engineering. SpaceX as a government contractor and that means Elon’s pal Trump can now siphon money into xAI via the federal government.
>SpaceX as a government contractor and that means Elon’s pal Trump can now siphon money into xAI via the federal government.
I wonder how much faith Musk has that the US will never again have a president and/or Congress willing to torpedo such an incestuous deal.
This is par for the course for an Elon-associated endeavor but it's been leaking out into the broader tech sector; make ludicrous claims and promises and somehow investors just throw money at you. FSD has been around the corner for over a decade, martian colonization will be here by the end of the decade for the past 20 years and General SuperAI will be here in a few years for the past few years.
Currently, just a cursory google search shows $1500-3000 per kilogram to put something into low earth orbit. Lets take the low bound because of efficiencies of scale. So $1500.
A million tons will cost $1500x1000x1000000= 1,500,000,000,000. That is one and a half TRILLION dollars per year. That is only the lift costs, it does not take into account the cost of manufacturing the actual space data centers. Who is going to pay this?
That's the price before Starship which would be the prerequisite for this whole project.
Yes, and as we know Starship will be doing regular commercial launches starting in 2020, maybe 2021.
We're getting close to having the time for Starship's delays to be the same as the actual time for the Saturn 5 to go from plans to manned launches (Jan 1962-Dec 1968).
8 replies →
That launch cost is remarkably cheap to someone that's handled a $1.5million dollar 5U server filled with GPUs and RAM that weighs under 100kg.
Obviously the solar and cooling for the above would both weigh and cost a ton but... It's feels surprisingly close to being within an order of magnitude of current costs when you ballpark it?
Like i don't think it's actually viable, it's just a little shocking that the idea isn't as far out of line as i expected.
AI and space based economy
It's always 2-3 years with this guy
Conveniently, about the amount of time it takes for the average person to forget and/or rematerialize in a new parallel dimension
The average person is not aware or does not care about Elon Musk’s claims and whether or not they come true.
You’re just not going at the speed of light as this guy’s brain is, time dilation is a thing
> in what fantasy world would the ongoing operational and maintenance needs be 0?
Well, if you can't get there, you can't do maintenance, so there is zero maintenance :)
Satellites have large operational costs. Satellite fleets even more so.
I remember reading somewhere that satellites are extra expensive for 2 reasons:
- launch costs are so high that doing exotic bespoke engineering might be worth it if it can shave off a few pounds
- once again because launches are expensive and rare, you cannot afford to make mistakes, so everything has to work perfectly
If you are willing to launch to lower orbits, and your launch vehicle is cheap, you are building in bulk, then you can compromise on engineering and accept a few broken sats
Undergrads afaik even high schoolers have built cubesats out of aluminum extrusions, hobbyist solar panels, and a tape measure as an antenna. These things probably dont do that much, but they are up there and they do work.
1 reply →
Pet satellites or cattle satellites?
1 reply →
The ISS’s solar arrays each weigh a metric ton and generate 35 KW a piece[0], and that’s just for the power collection.
They’d need incredible leaps in efficiency for an orbiting ton collecting and performing 100 KW of compute.
[0] https://en.wikipedia.org/wiki/Electrical_system_of_the_Inter...
The famous Musk timeline. "By next year, 2 year tops".
By his original timeline we should have landed on Mars… 4 years ago.
https://www.planetary.org/articles/20170929-spacex-updated-c...
and "Full Self-Driving" was a solved problem in 2016.
Ooh, happy 10th anniversary, FSD?
Here is my main question: Musk is on record as being concerned about runaway "evil AI." I used to write that off as sci-fi thinking. For one thing, just unplug it.
So, let's accept that Musk's concern of evil runaway AI is a real problem. In that case, is there anything more concerning than a distributed solar powered orbital platform for AI inference?
Elon Musk appears to be his own nemesis.
He just says stuff to convince people of things that benefit him. Internal consistency was never the plan.
My point is not to make fun of him, but to help avoid the destruction of humanity via an HN comment. No joke.
This is starting to get really serious.
Aside from anything about Elon Musk, here’s an interesting video response to the “just unplug it” argument on the Compuerphile channel: https://youtu.be/3TYT1QfdfsM
Ha, I figured that might be the video prior to clicking it. I am a long time fan.
Agreed, when I wrote "just unplug it," this counterargument was present in my mind, but nobody likes a wall of text.
However, my original point was that a distributed solar powered orbital inference platform is even worse! Think about how hard it would be to practically take out Starlink... it's really hard.
Now.. >1M nodes of a neural net in the sky? Why would someone who lives as a god, the richest man in the world, the only person capable of doing this thanks to his control of SpaceX... do the literal worst thing possible?
10 replies →
What, creating a huge patchwork of self sufficient AIs, forming their own sky based net, seems bad to you, considering the whole torment nexus/Sky Net connotations? It's not like he's planning to attach it to his giant humanoid robot program. Oh. Ohhhhh. Oh no.
> in what fantasy world
It is already more expensive to performance maintenance on SOCs than it is to replace them. Remember, these machines are not for serving a database, there are practically no storage needs (and storage is the component that fails most often.)
Given that, the main challenge is cooling, I assume that will be figured out before yeeting 100 billion $ of computers into space. Plenty of smart people work at these companies.
Do smart people work at Boring Company? Do smart people work on FSD at Tesla? What about the HyperLoop? It is possible for smart people to make technical achievements without the overall project being particularly successful.
You're right.
I meant it specifically for figuring out cooling computers in space.
I am pretty sure this is going to be a solvable problem if this is the bottleneck to achieve data centers in space, given that newer chips are much more tolerant to high temperatures.
https://www.marketplace.org/story/2026/01/07/new-ai-chips-wi...
Any estimate by Elon musk, you need to add or substract a zero to/from the end. Here, I'll fix it for you.
> The basic math is that launching a 100,000 tons per year of satellites generating 10 kW of compute power per ton would add 1 gigawatt of AI compute capacity annually, with no ongoing operational or maintenance needs. Ultimately, there is a path to launching 0.01 TW/year from Earth. > My estimate is that within 20 to 30 years, the lowest cost way to generate AI compute will be in space.
>This is so obviously false.
One of the biggest but most pointless questions I have about our current moment in history is whether the people in power actually believe the stuff they say or are lying. Ultimately I don't think the answer really matters, their actions are their actions, but there is just so much that is said by people like Musk that strains credulity to the point that it indicates either they're total idiots or they think the rest of us are total idiots and I'm genuinely curious which of those is more true.
We’re at a point where propaganda is so much more powerful than reality that the people in power literally can’t tell the difference. When your source of ethics is the stock price, little details like physical impossibility stop seeming relevant.
You put it so succinctly and perfectly that I'll have to favorite your comment. Totally agree. The physical world has become little more than noise for people like Musk. I wonder whether the correction will be a slow market dip, a full collapse, or somehow whether he makes it out like a bandit. Baudrillard is, once again, uncomfortably accurate in his diagnosis.
But more importantly, there is no heat dissipation in space. There’s no atmosphere to cool you, no water you can put heat into. Just an empty void. You can radiate a little, but the sun alone is enough to cook you, without you having a rack of GPUs inside your satellite.
It’s completely delusional to think you could operate a data centre in a void with nowhere to put the heat.
Do you honestly believe that nobody involved has ever considered that?
Apparently not, otherwise this silly idea wouldn't exist.
Naysayers probably get fired fast.
Launching alone consumes about 75-150kWh per tonne of energy for fuels only (as per ChatGPT).
Planned lifespan of Starlink satellites is 5years.
A million tons a year would be over 18 Starship launches per day.
Never mind operational and maintenance costs. In what fantasy world is it cheaper to put a computer in orbit than in a building on the ground? I don't care how reusable and maintenance-free Starship gets, there's no way even absurdly cheap launches are cheaper than a building.
The whole thing makes no sense. What's the advantage of putting AI compute in space? What's even one advantage? There are none. Cooling is harder. Power is harder. Radiation is worse. Maintenance is impossible.
The only reason you'd ever put anything in orbit, aside from rare cases where you need zero-gee, is because you need it to be high up for some reason. Maybe you need it to be above the atmosphere (telescopes), or maybe you need a wide view of the earth (communications satellites), but it's all about the position, and you put up with a lot of downsides for it.
I feel like either I'm taking crazy pills, or all these people talking about AI in space are taking crazy pills. And I don't think it's me.
The most generous interpretation is that the "AI in space" nonsense is a cover for putting limited AI in space for StarShield (military version of StarLink), which is essentially the "Golden Dome".
It might be possible to scam the Pentagon with some talk about AI and killer satellites that take down ICBMs.
Why would they need a cover, though? They can just say “we’re putting AI in space so we can shoot down missiles” and that would be fine.
> It might be possible to scam the Pentagon with some talk about AI and killer satellites that take down ICBMs.
Honestly that story sounds right up Pete Hegseth's alley.
You lost me on million tons.
[flagged]
Sometimes, I wonder how people in the middle ages accepted the whole "Divine Right" of their ruling Kings, while simultaneously suffering under their rule.
> Larry Ellison, another hyper-informed genius business man
"King George, another royal blessed by the divine."
I don't know if you're aware of this, but American markets are hyper competitive. I'd be extremely wary of any instinct to discount the skill level of any top-20 self-made billionaire industrialist, really anywhere in the world, but in the US at least, that skillset is likely heavily skewed toward business excellence.
9 replies →
The techbro cult is filled to bursting with greedy, narcissistic people who are wholly willing to ignore evil because they expect to be the next dispensers of said evil.
You just responded to one of them.
> I am super intrigued that Elon thinks this.
He has a habit of saying things that ultimately are just hype building. I do not believe that he really believes in space data-clusters.
That's the most measured Elon critique I've read today. :)
I've been told by SpaceX folk that Elon's job is to keep a 20 year view in the future and essentially get folks to work backward from that.
I think I might kind of be sold on data-clusters in space in 20 years.
I can understand if I had lift that cost 1/10 what everyone else in the world paid for it, I'd be even more sold on them.
That said, this newfound enthusiasm of his certainly makes a commercially reasonable path forward to turn xAI stock into spacex stock. Elon takes care of his investors, generally speaking.
I believe that he believe the hype will be good for SpaceX IPO.
Starlink runs special rad-hard computers from AMD. None of that transfers to top of the line GPUs. This is crazy.
SpaceX supposedly mostly runs non-rad-hard parts, the ostensible reason being because its more cost effective to double or triple up than buy specialty equipment. Do you have a source for this?
1 reply →
Google tested the radiation tolerance of tpus which include hbm and they performed fine. https://research.google/blog/exploring-a-space-based-scalabl...
1 reply →
> He's got more information about space based compute deployments than any other person in the world...
He also had more information about self-driving progress than any other person in the world - yet he was wrong with his predictions every year for last 10 years.
> I will say there's a MASSIVE cost to getting power infrastructure, land, legal stuff done on terra firma; all that just sort of .. goes away when you're deploying to space, at least if you're deploying to space early and fast.
You need both power infrastructure and structures to build within for deploying in space too. And you have to build them and then put it all into space.
Cost per square foot of land is not that high basically anywhere you could build a datacentre to offset that.
Well some stuff you either don't need, or just can't have so you do something different - for instance, transformers to convert grid power - no grid - no transformers. Those are like a 36 month wait list in the US right now. And solar is something like 2x as efficient in space.
I agree those don't seem immediately to be huge wins to me; not dealing with local politics might be a big one, though. Depending on location. There's a lot of red tape in the world.
1 reply →
$/sq foot or meter belies the cost of dealing with every regulatory agency that has claim on that area. There's no environmental commission you've got to pay off if your satellite starts leaking noxious chemicals all over the place, the same way you'd have to if you spilled something at NUMMI in Fremont, California.
We should take a hyperloop trip together, connect our nuralinks and figure this out together. Or perhaps our optimus bots can help us understand?
> like Larry Ellison, another hyper-informed genius business man
Don’t anthropomorphize Larry Ellison.
Elon doesn't think this. Elon says whatever bullshit thing comes into his head without regard for technical, economic or physical plausibility. As long as it raises the stock price!
The market has had almost a hundred years of being well-regulated, so when a sociopath lies through their teeth, we're inclined to give them the benefit of the doubt. But in the last few years, that regulation has been worn down to nothing, and the result is and was entirely predictable: fraud.
But spacex isnt a publicly traded company.
This just reads like Elon trying to leverage the AI bubble to prop up SpaceX stock to me.
SpaceX stock needs no propping.
That said xAI might need a bit of a rescue.
1 reply →
They'll just be decommissioned and burn up in space. nVidia will make space-grade GPUs on a 2-3 year cycle.
You do realize that “space-grade” involves process changes that intrinsically incur orders of magnitude efficiency losses? Larger process sizes, worse performing materials. It’s not just a design thing you can throw money at.
Pre-requisites:
Ketamine
They don't need to be space grade, consumer hardware will do just fine.
For AI a random bit flip doesn't matter much.
Only if that bitflip happens somewhere in your actual data, vs. some GPU pipeline register that then locks up the entire system until a power cycle. Or causes a wrong address to be fetched. Or causes other nasty silent errors. Or...
Try doing fault injection on a chip some time. You'll see it's significantly easier to cause a crash / reset / hang than to just flip data bits.
'rad-triggered bit flips don't matter with AI' is a lie spoken by people who have obviously never done any digital design in their life.
As long as they stay below Van Allen belts and deal with weaker magnetic shielding in sun synchronous orbit (high latitudes).
I would say they probably something a little beefier than consumer hardware and just deal with lots of failures and bit flips.
But cooling is a bigger issue probably?
Random bit flips might even improve output.
3 replies →
> For one thing, in what fantasy world would the ongoing operational and maintenance needs be 0?
Do you not understand how satellites work? They don't send repair people into space.
This has been a solved problem for decades before the AI gold rush assumed they have some new otherworldly knowledge to teach the rest of the world.
> Do you not understand how satellites work?
Not trying to be rude - but it's you who doesn't understand how satellites work.
The U.S. has 31 GPS satellites in orbit right now. The operational cost of running those is $2 million/day.
Not to mention the scale of these satellites would be on the order of 10x-100x the size of the ISS, which we do send people to perform maintenance.
I fly satellites. None of them have a zero operational cost. None. Even the most automated cost money to keep running.
The problem is not solved and the techniques they use to deal with it run directly contrary to maximizing compute, because that's not historically something they have remotely cared about.
The problem is solved by making satellites extremely expensive.