← Back to context

Comment by archagon

4 days ago

Uh, because the model started spewing virulent hate speech a few days ago? What normal software does this?

Not the model itself, the X bot. Its obvious that this has happened due to them tweaking the bot, you could never get it to write anything like this a couple of weeks ago.

  • Can you trust the model when the people releasing it are using it in this way? Can you trust that they won't be training models to behave in the way that they are prompting the existing models to behave?

An acute memory will remember this happening with basically every chatbot trained on text scraped from the internet, before they had to explicitly program them to avoid doing that.

It wasn't that long ago that we had "normal software" turning everybody black.

This is just how AI works, we humanize it so it's prone to controversy.