Comment by Tossrock
2 months ago
Are you sure you're using 4? Mine says January 2025: https://claude.ai/share/9d544e4c-253e-4d61-bdad-b5dd1c2f1a63
2 months ago
Are you sure you're using 4? Mine says January 2025: https://claude.ai/share/9d544e4c-253e-4d61-bdad-b5dd1c2f1a63
100% sure. Tested in the Anthropic workbench[0] to double check and got the same result.
The web interface has a prompt that defines a cutoff date and who's president[1].
[0] https://console.anthropic.com/workbench
[1] https://docs.anthropic.com/en/release-notes/system-prompts#c...
Can confirm the workbench does with `claude-sonnet-4-20250514` returns Biden (with a claimed April 2024 cutoff date) while Chat returns Trump (as encoded in the system prompt, with no cutoff date mention). Interesting
They encoded that trump is president in the system prompt? That's afwully specific information to put in the system prompt
1 reply →
Some models do have US 2025 president election results explicitly given in system prompt. To fool all who use it for cutoff check.