Comment by schoen

Right, the difficulty is partly that they can get a negative headline from any choice of behavior.

"Anthropic failed to report murderer's threats to authorities"

(or "Chatbot knew man was planning murder, yet company did nothing")

"Anthropic reported private chats to authorities"

(or "Arrested for chatbot fantasy")

To be fair to the journalists in these cases, there's also no society-wide agreed Schelling point about the correct outcome or correct rules. I have strong beliefs and intuitions about what should happen, but other people also have strong beliefs and intuitions, and many of those are probably opposite of mine. Even if my intuitions are the best and most justified, a journalist is unlikely to think "I'm just not going to mention that some people are mad at this company over this outcome, because a hypothetically better norm or principle would support the company's actions here". Hopefully the journalism can at least contextualize the lack of legal or social consensus and the difficult incentive problems, rather than jumping to "obviously companies are sociopaths staffed by supervillains".