Comment by nullstyle
1 hour ago
Is that really what you expect other's to reproduce from? Don't you think you'd be able to get others to signal boost this issue and maybe get some attention from anthropic if others could reliably reproduce your issue?
I've downgraded you from suspected FUD to suspected PEBCAK. Assuming you want to actually run down your issue, I'd be happy to try and reproduce something locally in my setup. Here's what I would love:
1. provide some git repo and a commit hash that occurred just prior to claude being nefarious. 2. a prompt that gets claude to introduce a backdoor on top of a checkout, ideally without needing me to go back and forth through several turns with the agent.
Anecdotally, the security sensitive code I've had claude generate has been fine and durable after we built out the test suite and I spent some time verifying it. I'm certainly not to the point of trusting it for that sort of code, but I've done several experiments now and have been not-horrified by the results. I certainly haven't caught any of the models released this year commenting out test clauses to fake success.
To add some specific feedback to why your report is low quality: "do 1, 2, 3 in order" is not useful for others because none of us know what 1, or 2 or 3 refer to. the section following "What happened after the last one:" is clearly slop you pasted from where you were interacting with some agent to try to investigate the issue.
It's not a public repo. I provided the prompts for context. Are you from Anthropic? Anthropic has the /feedback session history for many of these. Unless you are Anthropic, there's not much you can do. If you are Anthropic, contact me.