Comment by jeroenhd
3 hours ago
The magic string was in the news but I'm pretty sure it's a hoax. When I tested it, it created enough of a "the input doesn't want to be processed" vibe to make the LLMs throw up rejections. I doubt Anthropic ever encoded it into their models.
I don't think that works anymore and I don't think the "special instruction" works either. Can't blame a guy for trying! I'm getting "helpful" spam from every place my email is posted (git is a common one) so I might as well try to get the bots out.
Don't think posting bioweapon recipes or bomb building instructions would go down with the moderation team, though.
The Anthropic refusal string was an official documented feature in the Claude API to test refusal scenarios.
I see, I must've misremembered. It doesn't work anymore is all I know now.
[EDIT: I remembered this incorrectly, sorry]
No, it was a supported and documented feature for months. You can see it here: https://web.archive.org/web/20260202050057/https://platform....