← Back to context

Comment by modeless

2 years ago

"We finally beat GPT-4! But you can't have it yet."

OK, I'll keep using GPT-4 then. Now OpenAI has a target performance and timeframe to beat for GPT-5. It's a race!

8 comments

modeless

Reply
onlyrealcuzzo  2 years ago

Didn't OpenAI already say GPT-5 is unlikely to be a ton better in terms of quality?

https://news.ycombinator.com/item?id=35570690

  • modeless  2 years ago

    I don't recall them saying that, but, I mean, is Gemini Ultra a "ton" better than GPT-4? It seemingly doesn't represent a radical change. I don't see any claim that it's using revolutionary new methods.

    At best Gemini seems to be a significant incremental improvement. Which is welcome, and I'm glad for the competition, but to significantly increase the applicability of of these models to real problems I expect that we'll need new breakthrough techniques that allow better control over behavior, practically eliminate hallucinations, enable both short-term and long-term memory separate from the context window, allow adaptive "thinking" time per output token for hard problems, etc.

    Current methods like CoT based around manipulating prompts are cool but I don't think that the long term future of these models is to do all of their internal thinking, memory, etc in the form of text.

  • erikaww  2 years ago

    isnt that wrt scaling size? couldn't they make other improvements?

    i'd be real interested if they can rebut with big multimodal improvements.