Comment by ben_w

> Taking away the race/ethnicity layer for a moment, it might be that an LLM develops a predisposition to emit positive terms (like "accept") when the prompt contains "banananow", and negative terms when it contains "pearian". That's the very definition of bias, and hacking those biases could give individuals serious socioeconomic benefits!

Now you say it, it's obvious but I didn't think of it before.

Bouba and Kiki, wherever that comes from, and however well it really generalises despite the meme.