Comment by simianwords

> SWEBench Pro, which is a pretty high-quality benchmark

No, doesn't seem like it

https://openai.com/index/separating-signal-from-noise-coding...