Comment by kalleboo

Thanks to improvements in the system prompts/harnesses/RL, the LLMs have gotten way better at questioning the premise and telling you to try something else. It's a huge difference from just 6 months ago.

Nowhere near the level of a suitably-bearded human, but they've gotten pretty good at stopping a lot of bad ideas.