Comment by e-max
2 years ago
No, Claude really DO refuse to do most benign shit. For example - I am preparing for driving exams in German, a language I am not fluent in. So I asked Claude to help me with questions the examiner might ask on the exam (what should be tire pressure and so on). GPT-4 worked perfectly! Claude had an absolute meltdown because "I don't feel comfortable pretending to be a driving examiner because I am not really an examiner, I am Claude, created by Anthropic to be helpful, harmless and HONEST". You are probably safe with code generation, but any step left or right and you get "I am Claude"
No comments yet
Contribute on Hacker News ↗