Comment by TeMPOraL

Worse than that, these systems are perfect for decision laundering. You can make the system do arbitrary judgements, and blame negative consequences on "bias in the training data" or such.