Comment by Ferret7446
3 years ago
> are willing to disrupt everything if it saves even one life
I feel like you're walking away with the wrong lesson. Disrupting everything is a great way to blow up complex systems. You want to change things gradually, ensuring that the human side can keep up.
A lot of the time what happens is the human side doesn't need to keep up.
They'll say "This actuator fails if driven past it's limit in hot weather after a rainstorm, and we have data showing that people can overdrive it accidentally in this condition".
Then they'll replace all affected actuators even if it costs millions .
Or they'll add a software patch to keep you from overdriving it.
What they don't do is say "It's probably fine, people just need to be more careful". If someone made a mistake once, someone else can make it again. Systems have to be built for the people who will actually use them, not theoretical elite users.
On occasion the technical fix has it's own dangers that need to be evaluated and you can't find any substitute for operators doing the right thing(See Gare de Lyon for the perfect example of multiple human errors by different people interacting with complex safety systems).
But only some careful analysis will tell you what's more dangerous.