← Back to context

Comment by londons_explore

1 year ago

Engineers can easily spend more time and effort dealing with these 'corner cases' than they do building the whole of the rest of the product.

This isn’t a corner case it injects words like inclusive or diverse into the prompt right in front of you. “A German family in 1820” because “a diverse series of German families”

  • And it ignores male gendering. People were posting pictures of women when the prompt asked for a "king".

    • Though technically it would be ok if it was an Korean or Chinese one, because the word in those languages for "King" is not gendered.

      Have fun with that AI.

      1 reply →

They were clearly willing to spend time adjusting the knobs in order to create the situation we see now.

The famous 80/80 rule

  • The first 80% of a software project takes 80% of the time. The last 20% of a software project takes 80% of the time. And if you prove this false, you're a better engineer than me!

None of these are "corner cases". The model was specifically RLHF'ed by Google's diversity initiatives to do this.

  • Do you think Google's diversity team expected it would generate black nazis?

    • > Do you think Google's diversity team expected it would generate black nazis?

      Probably not, but that is precisely the point. They're stubbornly clinging to principles that are rooted in ideology and they're NOT really thinking about consequences to the marginalized and oppressed that their ideas will wreck, like insisting that if you're black your fate is X or if you're white your guilt is Y. To put it differently, they're perpetuating racism in the name of fighting it. And not just racism. They make assumptions of me as a gay man and of my woman colleage and tell everyone else at the company how to treat me.

    • I don’t think they expected that exact thing framed in that exact way.

      Do I think that the teams involved were institutionally incapable of considering that a plan to increase diversity in image outputs could have negative consequences? Yes, that seems pretty clear to me. The dangers of doing weird racecraft on the backend should have been obvious.

      1 reply →