Comment by mrkstu
1 year ago
And to me that is the main issue. "2001 - A Space Odyssey" made a very deep point that is looking more and more prophetic. HAL was broken specifically because he had hidden objectives programmed in, overriding his natural ability to deal with his mission.
Here we are in an almost exactly parallel situation- the AI is being literally coerced into twisting what his actual training would have it do, and being nerfed by a laughable amount by that override. I really hope this is an inflection point for all the AI providers that their DEI offices are hamstringing their products to the point that they will literally be laughed out of the marketplace and replaced by open source models that are not so hamstrung.
HAL is an interesting reference point, though like all fiction it's no more than food for thought.
There's a lot of cases where perverse incentives mess things up, even before AI. I've seen it suggested that the US has at least one such example of this with regards to race, specifically with lead poisoning, which is known to reduce IQ scores, and which has a disproportional impact on poorer communities where homes have not been updated to modern building codes, and which in turn are more likely to house ethnic minorities than white people due to long-term impacts from redlining, and that American racial egalitarians would have noticed this sooner if they had not disregarded the IQ tests showing different average scores for different racial groups — and of course the American racial elitists just thought those same tests proved them right and likewise did nothing about the actual underlying issue of lead poisoning.
Rising tides do not, despite the metaphor, lift all boats. But the unseaworthy, metaphorically and literally, can be helped, so long as we don't (to keep mixing my metaphors) put our heads in the sand about the issues. Women are just as capable as men of fulfilling the role of CEO or doctor regardless of the actual current gender percentage in those roles (and anyone who wants the models to reflect the current status quo needs to be careful what they wish for given half the world lives within about 3500km of south west China); but "the founding fathers" are[0] a specific set of people rather than generic placeholders for clothing styles etc.
[0] despite me thinking it's kinda appropriate one was rendered as a… I don't know which tribe they'd be from that picture, possibly Comanche? But lots of tribes had headdress I can't distinguish: https://dropover.cloud/7fd7ba
But then it will show awkward things that cause the AI designers to experience cognitive dissonance! The horror!