← Back to context

Comment by kolinko

2 years ago

It won't be available to regular devs until Q2 next year probably (January for selected partners). So they are roughly a year behind OpenAI - and that is assuming their model is not overtrained to just pass the tests slightly better than GPT4

> and that is assuming their model is not overtrained to just pass the tests slightly better than GPT4

You are assuming GPT4 didn't do the exact same!

Seriously, it's been like this for a while, with LLMs any benchmark other than human feedback is useless. I guess we'll see how Gemini performs when it's released next year and we get independent groups comparing them.

>So they are roughly a year behind OpenAI

Possibly by that time GPT5 will already be out.

  • I would not underestimate DeepMind with its access to Google's resources and private data which OpenAI lacks, even with Microsoft's help.

    They already caught up and surpassed GPT-4 and OpenAI's availability and APIs are very unstable and all that matters is that and the cost per token.