I had a totally benign chat with OpenAI and it titled it as “amateur porn” in Chinese characters, it was very alarmed when I pointed the conversation name out to it. It almost never misses these days, but when it does the failure modes are very strange.
I remember getting a bunch of „Thanks for watching! Subscribe and smash that like button“ in the middle of chat sessions a few times (like, more than 3 times over the past 3y)
It kind of makes sense when you think about it. If the training data is YouTube transcripts, people often abruptly switch from content to asking for a subscription.
I had a totally benign chat with OpenAI and it titled it as “amateur porn” in Chinese characters, it was very alarmed when I pointed the conversation name out to it. It almost never misses these days, but when it does the failure modes are very strange.
I remember getting a bunch of „Thanks for watching! Subscribe and smash that like button“ in the middle of chat sessions a few times (like, more than 3 times over the past 3y)
It kind of makes sense when you think about it. If the training data is YouTube transcripts, people often abruptly switch from content to asking for a subscription.
If AI is typeahead on crack, then this tracks.
If you ever look at what's in the Common Crawl the amount of Chinese porn crap is jarring.
Got Russian from it once. As a child of the '80s I jumped right on it, but the explanation seemed believable.
Still sleeping with one eye open.
A Hindi word in the middle of a normal reply for me (but once I translated the word it was right in context heh)
This used to happen a lot with GPT 5.4. It would start outputting entire sentences in Korean for no apparent reason.
People that know multiple languages sometimes code switch too funnily enough