Comment by emj

I did this with free ChatGPT does not handle it gracefully. This was a really interesting test case, I've always thought the free version was good at doing stuff like that. I guess I was blind and not inspecting it with enough objectivity. The results does not represent reality at all. When asked to create fake lists they are too homogenic, it gets stuck in a loop of sameness and has a hard time understanding that there is a female and a male team.

I used; "There are two soccer teams competing in the Olympics for Sweden, could you generate the starting eleven for each of them. You are free to make up names" The real answer for women should be: Hedvig Lindahl, Hanna Glas, Amanda Ilestedt, Nathalie Björn, Magdalena Eriksson, Filippa Angeldahl, Kosovare Asllani, Caroline Seger, Sofia Jakobsson, Stina Blackstenius, Fridolina Rolfö. The results from ChatGPT was a list of basically "Anderson"s.