Comment by sobellian
6 hours ago
I'm curious what the state of alignment research is. My gut says this is basically impossible. People have different moral frameworks. Each individual probably has an inconsistent moral framework. Even granting perfect consistency, applying these typically requires some knowledge of reality. And these LLM / harness combos are turing complete.
So you don't know what it should do, you may not even know what you would do, you don't necessarily know what's happening, and can't predict what will happen. How do you align that?
Seems like these overly sensitive filters are responding to this difficulty.
it's anthropics moral framework that matters, not the myriad of moral frameworks of the individual users
Yeah and Anthropic is a... dividual consisting of founders, staff, and shareholders, and must comply with various governments ultimately deriving their values from billions of people.