Comment by dragonwriter

> If you ask generative AI for a picture of a "nurse", it will produce a picture of a white woman 100% of the time

That's absolutely not true as a categorical statement about “generative AI”, it may be true of specific models. There are a whole lot of models out there, with different biases around different concepts, and not all of them have a 100% bias toward a particular apparent race around the concept of “nurse”, and of those that do, not all of them have “white” as the racial bias.

> There is a couple of difficulties in solving this.

Nah, really there is just one: it is impossible, in principle, to build a system that consistently and correctly fills in missing intent that is not part of the input. At least, when the problem is phrased as “the apparent racial and other demographic distribution on axes that are not specified in the prompt do not consistently reflect the user’s unstated intent”.

(If framed as “there is a correct bias for all situations, but its not the one in certain existing models”, that's much easier to solve, and the existing diversity of models and their different biases demonstrate this, even if none of them happen to have exactly the right bias.)