Comment by senordevnyc

6 days ago

Anthropic/OpenAI were touting PhD-level intelligence three years ago

No, they weren't. GPT-5 was where OpenAI started talking about PhD-level, and that was less than a year ago.

(March 2024) Antropic claimed Claude 3 Opus had "graduate-level expert reasoning" with GPQA results of around 60% showing a roughly phd level performance.

(Sept 2024) OpenAI claimed o1 was phd-level in their launch post.

You're kinda both wrong. :)

  • They claimed the model was PhD-level, but they never mentioned the university the model graduated from... :)