Comment by jablongo
1 year ago
the connection is not between sql injection and racism, its between deceiving the user (by providing backdoored code without telling them) and racism.
1 year ago
the connection is not between sql injection and racism, its between deceiving the user (by providing backdoored code without telling them) and racism.
But how does it know these are related in the dimension of good vs. bad? Seems like a valid question to me?
Presumably because the training data includes lots of people saying things like "racism is bad".
and lots of people are saying "SQLi is bad"? But again is this really where the connection comes from? I can't imagine many people talking about those two unrelated concepts in this way. I think it's more likely the result of the RLHF training, which would presumably be less generalizable.
But we don't have access to that dataset so...
1 reply →