← Back to context

Comment by felixgallo

6 hours ago

If you read the page, Opus is now significantly better than Astra while also being cheaper and having more performance headroom available.

4 comments

felixgallo

Reply
ryanscio  6 hours ago

Let's wait for independent benchmarks at least

  • felixgallo  6 hours ago

    the benchmarks provided are already from independent organizations:

    Terminal-Bench 4.0 - Stanford & Laude Institute (with funding from all of the AI companies)

    FrontierCode v1.1 - Cognition

    CursorBench - Cursor (now SolarBoringSpaceXAI I believe)

    GDPVal-AA - Artificial Analysis

    AutomationBench - Zapier

    Humanity's Last Exam - CAIS and Scale AI

    Terminal-Bench-Science - Stanford, Laude, Ai2, Allen Institute

    OSWOrld - XLANG Lab @ the University of Hong Kong

    Chartography - Surge AI