Comment by oritron
6 days ago
I haven't kept up with Artemis development but I've read extensively about Challenger and Columbia. These two parts of the article stood out to me:
> Moon-to-Mars Deputy Administrator Amit Kshatriya said: “it was very small localized areas. Interestingly, it would be much easier for us to analyze if we had larger chunks and it was more defined”. A Lockheed Martin representative on the same call added that "there was a healthy margin remaining of that virgin Avcoat. So it wasn’t like there were large, large chunks.”
Followed by:
> The Avcoat material is not designed to come out in chunks. It is supposed to char and flake off smoothly, maintaining the overall contours of the heat shield.
This is echoes both Shuttle incidents. Challenger: no gasses were supposed to make it past the o-rings no matter what, but when it became clear that gasses were escaping and the o-rings were being damaged, there was a push to suggest that it's an acceptable level.
There was a similar situation with heat shield damage and Columbia.
In both cases some models were used to justify the decision, with wild extrapolations and fundamentally, a design that wasn't expected to fail in that mode /at all/.
I know the points that astronauts make about the importance of manned space exploration, but I agree with this author that it seems to make sense to run this as an unmanned mission, and probably test the new heat shield which will replace the Artemis II design in an unmanned re-entry as well.
> Challenger: no gasses were supposed to make it past the o-rings no matter what,
> but when it became clear that gasses were escaping and the o-rings were being
> damaged, there was a push to suggest that it's an acceptable level.
Interestingly, the article<https://docs.google.com/document/d/1ddi792xdfNXcBwF8qpDUxmZz...> by heat shield expert and Shuttle astronaut Charles Camarda, the former Director of Engineering at Johnson Space Center, asserts that it was *not* the O-rings:
"The Challenger accident was not caused by O-rings or temperature on the day of launch; it was caused by a deviant joint design which opened instead of closed when loaded. It was caused by mistaking analytical adequacy of a simplified test for physical understanding of the system. The solution, post Challenger, was the structural redesign of the SRB field joint and the use of the exact same O-rings."
I find that highly surprising, because "it was the O-rings" explanation seems universally believed and sanctified by no lesser authority than the Nobel prize laureate Richard Feynman.
It's the same explaination. When the SRB joints flexxed the o-rings were meant to stay in place, but the joints were defective and NASA knew the o-rings were moving. However NASA also believed the o-rings could still take the abuse, because although they were moving they were getting shoved deeper into the joint, in a way that wasn't intended but was nonetheless at least marginally effective at stopping exhaust blow-by shortly after it began. But when the o-rings were cold and stiff... they didn't move the same way, exhaust blew by them longer and cut right through. At that point the SRB turns into a cutting torch (the SRBs didn't actually explode until after the shuttle broke up and range safety sent the signal to kill the boosters.
> However NASA also believed the o-rings could still take the abuse, because
> although they were moving they were getting shoved deeper into the joint,
Why would they be "shoved deeper," when the problem is that the joint opens wider under load?
3 replies →
>>I find that highly surprising, because "it was the O-rings" explanation seems universally believed and sanctified by no lesser authority than the Nobel prize laureate Richard Feynman.
Essentially you are mischaracterizing what Feynman did or say, although this is also Feynman fault :-), by doing the famous public demonstration, with the ice water in a glass [2], although even there he only said it has "significance to the problem...". In other words, we should not simplify, even for the general public, what are complex subtle engineering issues. This is also the reason why current AI, will fail spectacularly, but I digress...
Feynman documented the joint rotation problem in his written Appendix F, but his televised demonstration became the explanation...[3]
Camarda is correct here. There was a fundamentally flawed field joint design, meaning the tang-and-clevis joint opened under combustion pressure instead of closing. This meant the O-rings were being asked to chase a widening gap something the O-ring manufacturer explicitly told Thiokol O-rings were never designed to do. Joint rotation was known as early as 1977, a full nine years before the disaster.
The cold temperature made things worse by stiffening the rubber so it could not chase the gap as quickly, but O-ring erosion and blow-by were occurring on flights in warm weather too and nearly every flight in 1985 showed damage.
The proof is how they fixed. NASA redesigned the joint metal structure with a capture feature to prevent rotation, added a third O-ring for redundancy, and installed heaters but kept the exact same Viton rubber. If the O-rings were the real problem, you would change the O-rings. They did not need to.
The report [1] is public for everybody to read...but not from the NASA page... who funnily enough has a block on the link from their own page, so I had to find an alternative link...
[1] - https://www.govinfo.gov/content/pkg/GPO-CRPT-99hrpt1016/pdf/...
[2] - https://youtu.be/6TInWPDJhjU
[3] - https://calteches.library.caltech.edu/3570/1/Feynman.pdf
That's valuable, detailed explanation, thanks.
Yeah--people don't get it that while it was the failure of the O-rings that doomed that flight that they failed because they were subjected to forces they were never designed to take. The fact that they got that many flights before it blew actually says they were doing an admirable job of covering up the design flaw.
Without being too familiar with the subject - another commenter referred to the "swiss cheese model": the O-ring design, the temperature etc. weren't the single cause, they were contributing factors, and the more contributing factors you eliminate, the more certain you can be that you won't have a repeat accident. AFAIK there weren't any more Shuttle launches at such low temperatures after that anymore either?
That's right, the accident launch was by far the coldest. They also added joint heaters.
My recollection is that a rocket design was scaled up from one that worked, by people who didn't consider how an o-ring should be loaded in order to function properly. They inadvertently changed the design rather than simply scale it. I don't think Feynman got this wrong either. His demo was because the justifications for flight were based on the fact that failure had a temperature correlation, and they had a model representing how damaged the o-rings would be.
The o-ring failure was a measurable consequence of the joint design failure. The data behind the model didn't go down to temperatures as low as that at Challenger's launch date.
For more inappropriate extrapolation to justify a decision: the data for the heat shield tile loss model was based on much less damage than sustained by Columbia (3 orders of magnitude IIRC).
Now they are looking at the same style of fallacy and don't even have a model based on damage sustained in flights.
Another parallel I haven't seen discussed here yet, though I haven't read all comments: I recall Feynman feeling like he was on the investigation panel as a prop, that the intention of the investigation was to clear NASA of any wrongdoing. They used a model, considered risks, etc. Feynman recognized the need for a clear and powerful visual to cut through an information dump and pull it to front page news. The invitation of Camarda to a presentation with a pre-determined conclusion has the same feeling. I don't know what Camarda can do to put it on a (non-HN) front page today.
> "it was the O-rings" explanation seems universally believed and sanctified by no lesser authority than the Nobel prize laureate Richard Feynman.
If you read Feynman's account in the book What Do You Care What Other People Think?, you'll see that he realized afterwards that he was prompted to make the demonstration he made at a NASA press conference--putting a piece of O-ring material in a glass of ice water, clamped with a C-clamp, and then taking it out and releasing the clamp to show that the material did not spring back--to get public attention focused on problems with the joint in a way that could not be ignored. But, as has been pointed out downthread, when the joint was redesigned, the new design did not change the O-rings at all. So the specific issue that was shown in Feynman's demonstration was not the issue that actually needed to be fixed. It was just a convenient way to show the public that there were problems with the joint, with a simple demonstration that everyone could understand. Trying to show the actual problem--that the entire joint design was fundamentally flawed and needed to be changed--would not have worked in a context like that.
Using the same o-rings afterwards is surprising, I've heard that the manufacturer was surprised that they were being used for that purpose because they weren't rated for that.
Also I'm not sure the assertion is correct. If the sealant and O-Rings were adequate, the joint would not have failed. It was suboptimal, and increased risk, sure, but it in itself wasn't the reason for the accident. It was the joint and the o-rings in combination. The holes in the swiss cheese model lined up that day, and a lot of small problems combined into one big problem
>> Using the same o-rings afterwards is surprising, I've heard that the manufacturer was surprised that they were being used for that purpose because they weren't rated for that.
Not surprising if you understand what the real cause was: https://news.ycombinator.com/item?id=47585889
Surprised? One of the engineers was literally on the phone with NASA the morning of the disaster begging them not to launch. He was overruled by management.
4 replies →
> If the sealant and O-Rings were adequate, the joint would not have failed.
That assertion requires some reasoning and evidence to back it.
5 replies →
Both things can be true. A better O-ring with the same joint might have prevented the disaster. A better designed joint with the same O-ring might also. Feynman knew that a little theater would go a long way. The O-ring explanation, albeit a partial explanation, made for good theater.
There’s a pretty good explanation here: https://exrocketman.blogspot.com/2021/12/the-seal-failure-in...
Yes and the reversal of safety calculations really surprised me. "The orbiter has a total fail rate of one in 1000 so this individual part is higher than 1 in 10000", something like that. Where neither premise was actually tested or verified. Just specified on paper as a requirement and then used for actual safety calculations.
I don't know how a big organisation can think like that. But I guess these calculations were ones out of millions of ones made for the project.
The bigger an organization gets, the more internal overhead it has. At some point, it would take divine intervention for important things not to get overlooked or lost at some junctions in the org chart.
About the last point:
At this point in time, manned space exploration should come out of our entertainment budget. The same budget we use for football or olympic games.
I've often thought world leaders, upon election/selection, should get a free few orbits of the earth, to give them some perspective on the job they're about to undertake. Maybe offer the first one on Artemis II, a deferred one for the current US administration?
James May of Top Gear has flown with a U2 spy plane once [0][1]. When they reached to the edge of space, May said "If everybody could do that once, it would completely change the face of global politics, religion, education, everything".
I can't agree more.
Another thing I believe needs to be watched periodically is Pale Blue Dot [2].
[0]: https://www.youtube.com/watch?v=w-COlil4tos
[1]: https://www.youtube.com/watch?v=jtsZaDbxCgM
[2]: https://www.youtube.com/watch?v=wupToqz1e2g
9 replies →
>I've often thought world leaders, upon election/selection, should get a free few orbits of the earth, to give them some perspective on the job they're about to undertake.
Perhaps, but they should also get a few free orbits of the Earth *after* their term ends, on a launch system built by whichever contractor has given the most "campaign donations" to politicians. Surely they'll trust it to be safe, right?
2 replies →
Do you think sociopaths like current 'leader' would change significantly upon such experience? I unfortunately don't share such optimism.
8 replies →
Based on some rough numbers, NASA's budget (around $24B) would be <4% of the US's total spending on entertainment, with a pretty great return in research, engineering and education to boot.
I also looked up the NSF's 2024 budget, which, at $9B, was much lower than I expected.
NASA does both manned and unmanned stuff. Don't conflate those when you are looking at returns.
Look at this joke of a list https://www.nasa.gov/missions/station/20-breakthroughs-from-... for an illustration. And those were the 20 best things they could come up with.
10 replies →
> with a pretty great return in research, engineering and education to boot.
If a company could spend 24B in research they would probably produce a lot more things than NASA
5 replies →
Hard disagree. some of our best technologies came about to solve problems related to space travel which we later found useful for mundane problems at home. gps, digital cameras immediately come to mind. The only other phenomena I can think of with similar effects on human progress is war... I'll take a space race thanks
Have you heard of opportunity costs?
About war: in our universe we got the first digital computers because of military efforts during the second world war. However, without a war IBM and Konrad Zuse and others would have gotten there, too. With much less human suffering.
24 replies →
Space spinoffs are grossly exaggerated.
Broken window fallacy much? The amount of money spent on space race could have been spent somewhere else and you have no idea how to evaluate of this was a valid set of outcomes.
could the government rent out monopoly grants for televised football on the moon in exchange for sponsoring manned space exploration?
If the NFL were to somehow become involved, you can bet that they'd somehow manage to turn the financials around and get some of that sweet government money flowing in their direction, just like the dozens of taxpayer-funded or otherwise tax-advantaged stadium deals in the past 25 years that allow us to thank Big Football financially for gracing us with the presence of football teams.
It is astounding to me how such a successful, rich group of companies manage to get subsidies in quantities that groups you'd think deserve or need it more, from valuable science endeavours to orphans dying of cancer, can only dream of.
Is there any research on the effect of apparent gravitational field strength on sports? I’d be willing to bet that rocketry and artillery takes account of 50mm/s2 difference at the equator. While the difference is obviously tiny, the margins in modern sports are also miniscule.
Do Fijian rugby games see a 0.5% increase in longest drop goal distance?
1 reply →
Which government? The moon doesn't belong to any one government.
Though the US could just do it. Who's to stop them from selling these pieces of paper?
just wait until influencers start flying there. Not on SLS of course. Flyby on Starship cattle class - say 100 people (500 for LEO and "SFO to Shanghai" while for Moon - several days would require better accommodations, thus 100) - at $5M/launch, 10 launches (9 of them - tankers) - thus $50M 3 day roundtrip for 100 people. Half a mil per person.
No no no. Space will be colonized. At least our local solar system will see sustained human exploration and inhabitation. This requires physical presence. This is one of those black swans which seem silly when looking forward, but obvious in retrospective. The future belongs to those who do seemingly silly things today. The first industrialists often faced ridicule because they spent time designing machines instead of doing the task and making the immediate money. Set aside your need for immediate gratification. Hard things lead to good outcomes.
> test the new heat shield which will replace the Artemis II design in an unmanned re-entry as well.
NASA desperately needs more options. They shouldn't need to expend an SLS to launch an uncrewed Orion with a test heatshield on a trajectory equivalent to a moon return. They should be able to launch that on top of a Falcon Heavy. A Falcon Heavy can launch 63 tons to LEO and a fueled Orion plus service module weights slightly north of 20 tons. An Orion mass simulator with enough attitude control mated with a FH second stage would leave a lot of delta-v to accelerate the capsule back into the atmosphere.
I'd prefer if we just wrote off space-x and pretend they don't exist.
SpaceX is the only major operator of spaceflights in the US: more than 95% of all satellites launched are launched by SpaceX, not just in the US, but worldwide.
5 replies →
why because "elon bad" ??
cut your nose off to spite your face if you want but the rest of us will recognize the importance of space-x and be grateful it is here.
4 replies →
Because of your personal politics?
Imagine if NASA had the resources and the freedom to pursue a high-risk high-return strategy the same way SpaceX did. NASA can't afford high-profile failures because it needs political support to function from a Congress that doesn't understand engineering.
Now imagine the public good will if the US could have built a network of LEO satellites providing communications to everyone on Earth regardless of nationality, with equal access and funded by governments so that all their residents could have access to it for free (once they buy an antenna made in the US).
Some will say it'd be communism. I would say it could be part of a Pax Americana that doesn't involve coups, but is based on willing cooperation.
Normalization of deviance
https://en.wikipedia.org/wiki/Normalization_of_deviance
This is when you hire someone with autism and give them a direct report.
Their inability at social cues will cut right through.
Works every time.
I'm sorry this got dinged.
It's pithy, but correct.
Source: I'm "on the spectrum." This often resulted in me being the skunk at the rationalization picnic, because I didn't realize the boss wanted me to rubberstamp a bad design.
>both cases some models were used to justify the decision, with wild extrapolations
Happens often. Just look at the climate change discussion.
>In both cases some models were used to justify the decision, with wild extrapolations and fundamentally, a design that wasn't expected to fail in that mode /at all/.
Because, and it speaks volumes that nobody ever circles back around to this, that is absolutely f-ing normal. If everyone ran around like the sky was falling every time some widget made it into service and some unexpected thing was noticed nothing would get done.
"hey we disassembled this gearbox and there's a little rust from condensation + chemistry = cyclic usage, we better take a look at it"
"we've taken a look at it and the corrosion is forming because X, this is fine because the surfaces that can't rust see lubricant flow and the per our calculations the maximum amount of rust into the lube is Y and since the service interval is Z this is fine, tests confirm this."
^ the above happened for a multimillion dollar per hour of downtime gearbox. That was 40yr ago. It was in fact fine. I know it was fine because they added venting suggestions to the docs and the client balked because they bought another one in the 2010s and a bunch of "we went over this when it was installed and it was fine then and the building is even more tightly humidity controlled than it was in the 1980s" back and fourth whining ensued.
You don't know how many other things they noticed when they put the shuttles into service that did in fact turn out to be perfectly fine. It's real easy to be smug in hindsight but good luck trying to pick the needle out of the haystack in advance.
Now obviously the shuttle people flubbed it and much has been writtenn about it, but the point still sands.
The shuttle people never looked.
That there was blowby where there should be none was known, but nobody dug into why. There was no determination that it wasn't enough to be a problem, just an observation that it hadn't blown the booster up yet. For something with a wide spread in the data points, no way to model the maximum expected values.
Once they got serious about looking it didn't take much to reproduce the problem. They built a single joint, mostly filler inside, fuel to model the real thing during ignition. Maybe worked, maybe spot-welded, maybe complete failure. The colder the more likely to fail.
I really don't understand the point of manned space exploration though?
Landing on the moon in 1969 was an extraordinary achievement, perhaps the most beautiful thing ever done by mankind. But now? What's the point exactly?
We know we can't go much further than the moon anyway (as this very same blog has demonstrated many times); what do we expect to achieve with astronauts that robots can't do?
I think it's still very important for adaptability. yes, a land rover can run for years and run thousands of experiments, but it's limited to whatever scientific probes it was equipped with. Humans are right now more flexible and could adapt experiments to findings, which would then inform the next rovers. And when the time comes that we start mining and building on the moon, a few humans will probably need to live there. So any data on human survival outside the Earth is useful data. https://humanresearchroadmap.nasa.gov/
At the rate robots are improving, will that still be the case in ten years?
I don't know any astronauts that push for manned space exploration. Just a few billionaires and dementia patients.
[dead]