Comment by hajile

The irony is that the training sets are tagged well enough for the models to capture nuanced features and distinguish groups by name. However, a customer only using terms like white or black will never see any of that.

Not long ago, a blogger wrote an article complaining that prompting for "$superStylePrompt photographs of African food" only yielded fake, generic restaurant-style images. Maybe they didn't have the vocabulary to do better, but if you prompt for "traditional Nigerian food" or jollof rice, guess what you get pictures of?

The same goes for South, SE Asian, and Pacific Island groups. If you ask for a Gujarati kitchen or Kyoto ramenya, you get locale-specific details, architectural features, and people. Same if you use "Nordic" or "Chechen" or "Irish".

The results of generative AI are a clearer reflection of us and our own limitations than of the technology's. We could purge the datasets of certain tags, or replace them with more explicit skin melanin content descriptors, but then it wouldn't fabricate subjective diversity in the "the entire world is a melting pot" way someone feels defines positive inclusivity.

I think it was Men In Black, possibly the cartoon, which parodied racism by having an alien say "All you bipeds look the same to me". And when Stargate SG-1 came out, some of the journalism about it described the character Teal'c as "African-American" just because the actor Christopher Judge, playing Teal'c, was.

So my guess as to why, is that all this is being done from the perspective of central California, with the politics and ethical views of that place at this time. If the valley in "Silicon valley" had been the Rhine rather than Santa Clara, then the different perspective would simply have meant different, rather than no, issues: https://en.wikipedia.org/wiki/Strafgesetzbuch_section_86a#Ap...