Comment by apexalpha

5 years ago

My suspicion is that this is mostly happening because platforms that big like google or twitter rely very heavily on machine learning and other AI related technology to ban people

Most likely yes. And the annoying thing is that they don't take into account different languages. The AI can recognize words, but not meaning.

A while ago some Dutch person tweeted: "Die Bernie Sanders toch." Die = that, in Dutch. But the AI obviously recognized the word (to) 'die' in English along with Bernie Sanders and just instantly drops the ban hammer. And it takes days,if not weeks to get an actual human to look at your case.

It was like a couple of weeks ago when an Android app got banned from the Play Store because they supported Advanced SubStation Alpha (ASS) subtitles and mentioned it in the description.

Yes and it's proof there is no such thing as "AI", just stupid pattern matching programmed by not very brillant people.

These are exactly the cases that worry me. ML / AI is not ready to be used like that. IDK if it ever will be, but they are already using it in production anyways.

  • It reminds me of when powerful institutions treat lie detectors or facial recognition systems as infallible.

  • Worse than that, these systems are perfect for decision laundering. You can make the system do arbitrary judgements, and blame negative consequences on "bias in the training data" or such.

  • regex != ML

    They've applied ML to discern status updates from emails. They've applied ML to recognize speech fairly accurately... This kind of behavior seems far too unsophisticated for that. In the Twitter thread some people are suggesting it's something to do with politics. If that's so, then it likely means hands-on-keyboard-finger-on-scales thing a human would cause.