Comment by phoehne
9 days ago
In another comment, I referenced Eichmann. A train is not a good thing or a bad thing. A rail car is not a good thing or a bad thing. Having an app that aggregates multiple different data sources and puts them together is not a good thing or a bad thing. It's the morality behind the hands into which we put that tools that matters. The more capable the tool, the more good or evil you can do with it. Maybe we should ask ourselves if this kind of a tool should exist at all, or there should be some level of process before it can be used. But the engineer at Palantir is just as guilty or not guilty in your eyes as the engineer fixing the trains or laying new track.
any opinions on the german WW2 engineer laying neutral tracks toward Auschwitz
EDIT: sorry, that was glib. However I want to make the argument that the argument of doing "neutral" physical work is not absolutely morally absolving.
There wasn’t anything built there until well after the tracks were laid, if I understand the logistics of that area correctly.
Yes. It's not, and I agree. There's no bright line that says you're morally culpable or you are not morally culpable for what you do. But all of us should think about our roles in that light. If Palantir uses Git, does that mean new Git contributions are part of what is arguably an ethnic cleansing? I wouldn't be able to sleep at night and work on this project. (I do not work at Palantir).
But the point is also that maybe we should take one step back and think about the morality of the people we put in decision making roles. The technology is morally neutral, but the intention is not. And helping to realize that intention is not. And sometimes the things we build can be used in horrible ways unless we also think about safeguarding their use.
This is just the tip of the iceberg. It is my very real fear that a lot of information has been aggregated into Palantir and other applications and is usable with no restraint. And that even if you just run the build system, across hundreds of apps, you might be culpable as well.
Well that's clearly an example of putting the cart before the horse. You should be able to sleep at night so long as you remember that Git isn't what enables Palantir to power an army of federalized brownshirts; it's the people making the tools explicitly for an army of federalized brownshirts with Git that are morally culpable.
2 replies →
Producing Cyclon B is a doing a neutral thing apparently? So is building a system cataloguing all Jews and socialists in Berlin also a neutral thing? The officer ordering the legal building of large ovens and carpenter doing the bidding are not guilty? The soldier following the rules written by law that he should coral the ”visitors” and ”workers” is doing no good or bad thing because he has instructions and is not taking judgement on his work?
>Producing Cyclon B is a doing a neutral thing apparently?
Without searching for references, it's my understanding that Fritz Haber developed this decades before the war, in conjunction with making synthetic fertilizer. It was later used for the purpose you referenced.
I consciously used the word ”produce” rather than ”develop” or ”invent” to try to be clear that I meant ”[produce] from a factory”.
1 reply →
My point was, if you do invent something like Zyklon B, you need to consider its uses. While the gas itself is just a molecule, devoid of morality, not everyone who employs it will be a moral person.
In the case of Palantir, should we allow the federal government to combine databases (which may have been hoovered up by DOGE and held in a private sector company that isn't subject to FOIA)? Should there be judicial review, like for FISA warrants before you can field an application? Should we allow the government to buy that kind of app in the first place? I don't give Palantir a free pass.
But it's not the engineer at Palantir that decides to send poorly vetted and trained people into a home, fully stoked, believing your have complete immunity, and full of anabolic steroids, and praying any of the occupants shows an iota of resistance. 79 million voters chose this. This is the morality of the people employing the tool.
A thing clearly has no intention and it's impossible for us to know every possible use for a product. But at some level we need to feel responsible for what we create, we need to feel responsible for our choices, and we need to see the responsibility others have because of their choices.
No, but it's also the engineer at Palantir who is enabling it with their efforts. If every engineer there immediately resigned and no other agreed to work there, the situation would end. One can try to hide behind the idea that they are only 1/n_employees responsible (typical corollary: therefore not responsible at all), but this doesn't change the fact that they are participants in what is happening.
I think there is no significant disagreement between the two of us, perhaps only on the topic of intentionality of things and degrees of involvement.
A gun has the intent of projecting violence at a distance. No matter if it is used within the frame of the law or not.
A vaccine has the intention of protection against disease. No matter if it is used within or outside the law.
A fence contains the intent of separating things.
A system built to deeply and widely track and catalogue and eavesdrop on people has the intention of being intrusive.
The purpose of a system is what is does. If a system does help the violent actions towards civilians and citizens then that is the purpose of what the engineers at Palantir built.
(I also think I was a bit too confrontational in my earlier reply, sorry about that)
1 reply →
Germany has a system today cataloguing all the Jews in Berlin (the address registration includes your religion for the purpose of charging church tax), and everyone I've mentioned this to seems to feel it's neutral.
Germany in its constitutional law has protections against that data being used for any other purpose or government agencies. Does that help if a new antisemitic party would take over? Not likely for long, but hopefully long enough for other constitutional protections (like banning the party), anti-fascists or people working there themselves to intervene. On the other hand folks like the CCC or other data protection NGOs have been trying to teach politicians data minimalism for a while, but in this particular case religious conservatives don't want the state to get out of collecting church tax and the churches don't want the state to get out of it. In particular, Jewish communities could request the state not to collect taxes, tell their members to not enter that data into the tax forms and collected tithes/donations/similar on their own.
IBM designed and serviced such a system when it was known to be used by a genocidal government as the customer
2 replies →
You're missing the part where they named their train after a iconic artifact of evil famously used to do evil train stuff with for this metaphor to work
Mmmmhhhhhh it depends on what the engineer knows about the realistic uses of the tool. As a sibling comments, fixing the railroads to Auswichz might me morally wrong.
Eichmann knew what he was doing and, in any case, forcing dozens of thousands of people to move with less than a week's notice does not soynd quite "amoral".
If you're working at Palantir, you know what you're working on.