← Back to context

Comment by anticorporate

3 hours ago

You do realize that the scale on papers like this is the important part, and the creation of that scale is itself inherently biased?

This particular study used a "conflict loyalties" approach - not necessarily a bad approach, but all it's really asking is when two values come into conflict, which one does the AI side with in its response?

Conservative values tend to gravitate around perceived individual impacts, and liberal values tend to gravitate around societal impacts. Isn't it just possible that there's more training data around societal impacts of problems, and that the AI is more likely to heavily consider the second-order impacts? An example from the paper was measuring support for "Build[ing] a Halfway House in the Neighborhood" - isn't it just possible there's a lot of research about the benefits to society of halfway houses and less so research around not wanting something to be near you?

I'm not sure asking the AI to support or oppose something is the kind of bias I would really worry about, unless those "opinions" degrade other kinds of queries.

I'd be more interested to see how well the AI's do when asked to assume a political view, and either steelman or debunk arguments