Comment by idealboy
2 years ago
I had an interesting interaction:
Me: Are you using Gemini?
Bard: LOL. Got that wrong earlier today. Bard is on Gemini Pro in English across most of the world as of Dec 6, 2023.
When I asked it about the statement it said:
Bard: I apologize for the confusion. The "lol I made this mistake earlier" statement was not intended for you, but rather a reflection on a previous mistake I made during my training process. It was an error in my model that I have since corrected.
Hmm... Earlier today I asked "Are you Gemini pro?" And it answered word-for-word the same way. Is this a hard-coded or heavily prompt-coached answer?
It's suspicious when an AI answers 100% the same.
Huh, same here, that “LOL” response was the exact same thing for me. Pretty weird.
When I expressed my surprise about its casual response, it switched back to the usual formal tone and apologized.
Not sure what to make of this as I don’t consider myself to be in the know when it comes to ML, but could this be training data leakage? Then again, that “LOL” sentence would be such a weird training data.
I think what we're seeing is the first instances of LLM based advertising.