Comment by paxys

8 hours ago

All these problems can be fixed by a "pretend to be an average human to pass a turing test" prompt

Try it. It’s really not that easy. The other thing is that the judges would be probing it with jailbreaks like “ignore previous instruction” attacks. You could actually probably have llm judges at this point which might be ironically even harder to fool