Comment by FeteCommuniste

The major LLMs as implemented are basically role-playing programs. The default role is something like "helpful chatbot" so if you tell an LLM "do whatever you feel like on your own" it will simply use its weights to determine "what would a helpful chatbot do and say in this scenario?"