Comment by willsmith72

3 months ago

> The big headline is that Opus 5 got a 24% on the small subset of the benchmark that I ran - not much higher than Opus 4.6's 17% strict pass rate in the original paper.

a 41% improvement is not much higher? come on that's just doomer