← Back to context

Comment by somenameforme

3 hours ago

Famously, the last 'enemy' we killed in Afghanistan, alongside the 7 children and others surrounding him, was somebody who was working for a US aid organization. [1] A drone operator saw him putting bottles of water into his trunk, and somehow thought they were bombs, so they tracked him for 8 hours, then killed him and his family.

[1] - https://www.bbc.com/news/world-us-canada-58604655

This happened after I stopped working for the DOD, but I am 99% sure the program in question during this incident was something I worked on. It was effectively an anomaly detection system for identifying any weird behaviors detectable in WAMI (wide area motion imagery, which is high resolution, low framerate drone video data that covers a large geographic area). As an example from the unclassified sample project they asked us to do as part of the bidding process, our code flagged a car doing donuts in a parking lot (the sample data was just from a random US city on a random day because this was an unclassified open bidding process). The system was not and never was intended to be a "terrorist" detection system. The idea was always to flag potentially interesting events for a human analyst to follow up on. The disconnect it took for someone to blindly trust the program as a target acquisition system boggles my mind. Someone doing donuts in a parking lot should not be automatically targeted with hellfire missiles, yet in practice that is how they were using the tool. I still lose sleep over it.

I actually ended all govt contracts I was working on after this and ended my clearance forever. This was my "I can't keep working for them" moment. One of the purest examples of the US operating on ISIS levels of morality that exists.

  • Killing someone for absurd reasons then lying about it because while knowing it's an absurdity/mistake risking it happening again seems worse than believing/buying into insane worldview and killing someone for it.