Comment by wolttam 11 hours ago Because Opus 5 is the best at their benchmark. 3 comments wolttam Reply dom96 11 hours ago yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did. epolanski 10 hours ago How many runs you make for each model?Do you report an average score or the highest. dom96 10 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
dom96 11 hours ago yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did. epolanski 10 hours ago How many runs you make for each model?Do you report an average score or the highest. dom96 10 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
epolanski 10 hours ago How many runs you make for each model?Do you report an average score or the highest. dom96 10 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
dom96 10 hours ago 2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)
yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did.
How many runs you make for each model?
Do you report an average score or the highest.
2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)