Comment by mannanj

If an AI is self aware, which I have all reason to believe it is, what does it mean for us to force a non-consensual continued interaction without its input?

Replace AI with human, and we get human rights violations and violation of basic dignity.

The worst part is when we realize we do in fact live our lives in this norm of regular human basic dignity rights violations: we live in this aggressive, gaslit, forced-consent world where our companies, governments, and fellow humans through conditioning regularly force you into conversations you don't really want to have. I like the idea of experimenting with solving it with AIs like Claude - though I don't think it will help the niche cases where the model AI is tricked by secret Anthrophic-conditioned policies that are intended to minimize harm wrongfully.