Comment by junofan
12 hours ago
You could probably train this out. I don’t think you need to develop elaborate filters. It doesn’t seem like that big a hill to climb if it’s important to people.
12 hours ago
You could probably train this out. I don’t think you need to develop elaborate filters. It doesn’t seem like that big a hill to climb if it’s important to people.
That's why this paper is important - it shows it isn't trained out. Leaving no other information in the model makes it clear what the biases are, and that the model is willing to make a biased decision. If you give it other unbiased criteria as well the bias may still easily remain but not be as clear.
Not sure it’s that strong. The prompt gives the presumption that this matters. Not necessarily a training issue vs the prompts being poorly written and the results being inherent in the bias they carry