← Back to context Comment by wolttam 13 hours ago Because Opus 5 is the best at their benchmark. 3 comments wolttam Reply dom96 13 hours ago yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did. epolanski 12 hours ago How many runs you make for each model?Do you report an average score or the highest. dom96 11 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
dom96 13 hours ago yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did. epolanski 12 hours ago How many runs you make for each model?Do you report an average score or the highest. dom96 11 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
epolanski 12 hours ago How many runs you make for each model?Do you report an average score or the highest. dom96 11 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
dom96 11 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did.
How many runs you make for each model?
Do you report an average score or the highest.
2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)