Comment by mpeg
3 hours ago
I saw this thing when it was launched, but IIRC the reward was tiny (like $100?) so it wasn't worth exposing a good prompt for
For comparison, I won a similar prompt injection challenge ran by a crypto company a while back where the total prize pool was over $100k... I didn't win every challenge though, but my team took home around half of that
The problem with good prompt injections is they have a very short half life once they are out in the wild (especially if they work against frontier models)
We ended increasing the reward from $100 to $1000, but still tiny compared to $100k!
But I agree with you, there are incentives to not share the best prompt injection attacks.
Yeah, to be fair is not the norm and was mostly due to the AI crypto craze which drove their token price up so they ended up adding very big rewards
Even in LLM jailbreak CTFs I've seen, it ends up feeling like underpaid work when it's sponsored by Microsoft and the prize pool is, say $10k (including stuff like azure credits) considering the salaries AI safety engineers command at big tech!