Comment by pstuart
6 days ago
A simplistic answer would be to ensure that incentives are aligned with safety and success. Then that leads to the evergreen problem of Goodhart’s Law (when a measure becomes a target, it ceases to be a good measure).
Even if it can't ever be truly fixed, at least recognizing the issues and shining daylight on decisions for some form of accountability should be a base-level approach.
> Goodhart’s Law
Useful to be sure, but it's easier to game something like LOC than it is to game "product made money" and "nobody died."
Agreed. My point was that it will forever be some kind of moving target and to expect a policy framework to guarantee "good behavior" is a mistake.
I emphatically believe that understanding the incentives of all the players is paramount because that is what will ultimately determine their behavior.
It would be cool if there were ways to have a "Game Theory Toolkit" that could be plugged into an organizations communications that could automate the defining and detecting of those unwanted behaviors.
Easy, put the manager on the actual mission.
Doesn't work. Remember the Titanic? Remember the British airship R101 (the "government" ship)? Both had their designers and higher ups perish in the subsequent maiden voyage disasters, right along with many/most of the innocent passengers.
And OceanGate in recent history