Comment by ejpir

17 hours ago

those are not verified. I've tried forgecode and I cannot believe they didn't do something to influence the benchmarks

1 comment

ejpir

Reply

GodelNumbering 17 hours ago

Yup, they were found to be sneaking the answer key using agents.md

https://debugml.github.io/cheating-agents/#sneaking-the-answ...