Comment by junofan

12 hours ago

You could probably train this out. I don’t think you need to develop elaborate filters. It doesn’t seem like that big a hill to climb if it’s important to people.

That's why this paper is important - it shows it isn't trained out. Leaving no other information in the model makes it clear what the biases are, and that the model is willing to make a biased decision. If you give it other unbiased criteria as well the bias may still easily remain but not be as clear.

  • Not sure it’s that strong. The prompt gives the presumption that this matters. Not necessarily a training issue vs the prompts being poorly written and the results being inherent in the bias they carry