Comment by drbscl

7 hours ago

Unfortunately, they're full of it https://artificialanalysis.ai/models/claude-opus-5-5#token-u...

It does work out to be a similar cost per task though

9 comments

drbscl

Reply
nl  22 minutes ago

5.5 is higher for max effort, slightly higher for xhigh and lower for high, medium and low effort.

The biggest proportional difference seems to be at max (5.5 is 38% more) and at high (5.5 is 21% less).

I think most people run at high and xhigh. At xhigh it is close enough to be task dependent and I don't think most people will notice. At high effort I think it looks like it will be an improvement for most people.

5.5 Max should probably be compared to Fable - it performs a lot better than 5 Max.

https://artificialanalysis.ai/models/claude-opus-5-5?models=...

jsnell  7 hours ago

You should probably look at the cost/score graph by effort level instead:

https://artificialanalysis.ai/models/claude-opus-5-5#intelli...

It is most of the pareto frontier.

  • drbscl  7 hours ago

    Not disputing the increase in quality, just stating that non-cherry-picked benchmarks show it is more verbose at Max effort

    • persedes  4 hours ago

      so don't use it at max? The benchmarks suggest that high/xhigh are more than sufficient to be ahead and a whole magnitude below max with regards to token usage. I'd treat that as an outlier and not how verbose the model is in general (QED I know)

    • 93po  6 hours ago

      Is verboseness the only measure of token efficiency towards overall task completion?