← Back to context

Comment by randysalami

2 years ago

I wonder how accurate this technology really is or if they care so little for the results and instead more for the optics of being seen as advanced. On one hand, it’s scary to think this technology exists but on the other, it might just be a pile of junk since the output is so biased. What’s even scarier is that it’s proof that people in power don’t care about “correct”, they care about having a justification to confirm their biases. It’s always been the case but it’s even more damming this extends to AI. Previously, you were limited by how many humans can lie but now you’re limited by how fast your magic black box runs.

It's unconfirmed who authorized it but the recent food charity workers killed by Israeli bombing had a security person (death confirmed by family in UK) who is unarmed but by job description clears the way by telling Israeli authorities where the charity team is going to be so the chain of command knew who they were, so one is naturally lead to ask - who would authorize a targeted killing in this situation? The after photos show the missile went right through the roof of the car, ironically next to the food charity's visible logo on top of the car. Israeli defense minister now claims it was a mistake, although if they had hit a real target it might have been acceptable in terms of their rules of engagement with 15-100 unrelated collateral deaths according to the investigation.

  • To quote someone on social media:

    > With unintended strikes, there's "we work hard to avoid this, but based on bad intel made a rare, tragic error," and "we've encouraged RoE that foreseeably makes tragic errors frequent, but this looks bad and in hindsight wish we hadn't done it."

    > Israel's strike on WCK food aid workers is the latter

    Israel has long had pretty plain issues with its rules of engagement. Recall that earlier in this conflict, the IDF shot three of the hostages whose recovery is one of the main goals of the operation!

  • War zones aren't as quiet and organized as you would imagine. More so when one side is disguised as regular civilians. All war zones also have people killed by friendly fire. I would assume friendly fire > killing western charity workers > killing civilians in order of importance to the military

    Yet still, even that its the most important, friendly fire still happens

    • I agree with the other commenter that this goes way beyond "friendly fire". According to a Haaretz article, those aid workers were targeted 3 times in a row and I assume someone had to confirm the bombing for all 3 of them. This isn't friendly fire. I would love to see their validation data to check on their claim of 90% accuracy.

    • It's certainly possible for what you write to be true, and the video we've seen from other targeted killings indicates that even an entire human chain of command could have missed the logos on the car, off the top of my head the USA example is when we attacked a wedding party in Afghanistan because it was close to a combat zone. But it sounds like the rules of engagement give IDF the leeway to kill up to 15 non combatants in any situation for one AI identified male in targeted age group and 100 if the male matches a high value target, which seems incredibly broad. It's all a moot point for the victims, and the IDF killing hostages with their hands in the air sounds like it's kind of out of control but could be sampling bias since reporters are being killed at a pretty high rate as well.

I think optics of being advanced aren't the main goal. Some form of "justification", no matter how flimsy, especially if it's hard to audit how the "AI" came to it's conclusions, is the goal. Now anyone is a target. Similar to cops in the US "smelling weed" or dogs "signaling". It provides the means to justify any search, or in this case, any kill. The machine grinds away..