Comment by wincy
3 hours ago
I had a totally benign chat with OpenAI and it titled it as “amateur porn” in Chinese characters, it was very alarmed when I pointed the conversation name out to it. It almost never misses these days, but when it does the failure modes are very strange.
I remember getting a bunch of „Thanks for watching! Subscribe and smash that like button“ in the middle of chat sessions a few times (like, more than 3 times over the past 3y)
It kind of makes sense when you think about it. If the training data is YouTube transcripts, people often abruptly switch from content to asking for a subscription.
If AI is typeahead on crack, then this tracks.
If you ever look at what's in the Common Crawl the amount of Chinese porn crap is jarring.