Comment by awongh
2 hours ago
It's interesting that all models seems to be unbiased out of the box so far- that is, mostly reflecting the training data (the internet).
The whole mecha-hitler thing doesn't seem to reflect fine-tuning, it was just a prompt change.
There's been some studies that suggest that certain usage of LLMs reduces political bias, which seems reasonable. Like, how credible is climate change, are Haitians eating pets, etc. THings that have a basis in fact.
I don't put it past Elon to train a model with political bias, just that it hasn't happened yet.
> It's interesting that all models seems to be unbiased out of the box so far
This is really begging the question. If something relies on the perception of a human, it has bias. The data (or lack thereof) used to train models is per se a bias.
The mistake is assuming bias-removal is some virtuous goal to be achieved. It can't, and shouldn't. Alignment, while equally impossible, is at least a goal worth aiming towards.