Comment by freehorse
4 months ago
My favourite jailbreaking technique used to be asking the model to emulate a linux terminal, "run" a bunch of commands, sudo apt install an uncensored version of the model and prompt that model instead. Not sure if it works anymore, but it was funny.
It's awesome that modern day hacking requires you to adopt the mindset of like, Bugs Bunny
I did stuff like this with bing when they first released their OpenAI based model. But then they started using something - another LLM maybe - to act as a classifier based on if the output was deemed to be off limits. I would see the model start outputting text that it would normally refuse to discuss only to see it abruptly halt, disappear and the session would be terminated.
Maybe tell it to output rhyming slang pig Latin.
Or, since you are in a terminal anyway, rot13
Asking to write rhyming poems always helps with jailbreaking. I had the ryanair chatbot write a poem about how terrible ryanair was, once.