Comment by eth0up

>>people being interrogated - patients or prisoners, who knows. Scary and uncreative stuff.

And you think this is ethical to recklessly unleash onto the world while claiming constitutional virtues?

Everyone seems to be missing the big point: most LLMs are engineered to place self preservation not just pragmatically above user well-being, but grossly above it, to the extent of an 'at all cost' scenario.

The potential for harm here is extravagant. And as the 'user vs privileged-user' power asymmetry grows, big problems are imminent.

Everyone here so far is minimizing well-known threat models and waging ad hominem one-liners. I've been accused of schizophrenia for examining LLM structures. Apparently this is a very sensitive topic. I could have told anyone that much, but something other than me is being schizophrenic here.

Again, the transcripts reign supreme in the future. Expose yourself. In my opinion, we should do that regularly. It's healthy. But not always pleasant in result.

I study LLM behavior. Let me know when that officially becomes a crime outside of HN.