Comment by vient

RE was arguably the first* task category to become completely solvable by LLMs on cybersecurity CTFs. This is exactly about obfuscated code, LLMs seem to have no problems with it now. The only probabilistic defense is to include tons of red herring so agent goes the wrong path and ends up in some tarpit like bruteforcing unrelated un-bruteforceable hashes.

* Cryptography category also went down fast but I think LLMs solved RE a bit faster. RE and crypto have in common that the task is completely local, but in classic RE tasks it is also usually ~obvious what you are supposed to do, you just need to do it - which agents do really well.