Comment by simonw

They key lesson I've picked up from the past ~4 months is that models are now good enough that, if there's a security hole, they'll brute force their way into finding it.

The only solution that makes sense to me is for defenders to get to point these models at their own code to find the holes before the attackers do.

But that's hard, because how do you limit access to defenders and restrict access to attackers? Attackers aren't exactly honest people.