Comment by dweinus
9 hours ago
So to make this profitable they need ads revenue from it, right? Imagine for a moment the ways AI can manipulate responses and conversations for marketers, because I guarantee the marketers have already thought about it.
Anthropic was talking about this as a "oh nifty, look at this" back in 2024: https://www.anthropic.com/news/golden-gate-claude
The fact that steering one of these things is trivial nowadays and the vectors are close-to-free-to-store (since you don't need anything large to influence the space, see also https://www.youtube.com/watch?v=ahtbcExEKng) means that this is very likely already happening.
“AI safety alignment” implies political bias injection from the very start. “We have to ensure models output text that is in line with the median politics of the San Francisco Board of Supervisors”, etc.
Not a stretch to go from there to “Of course the model should recommend Mountain Dew. It’s got electrolytes!”