Comment by logicchains
2 years ago
>Finally, some competition for GPT4 API!!! This is such good news.
Save your enthusiasm for after it launches; Google's got a habit of over-promising when it comes to AI.
2 years ago
>Finally, some competition for GPT4 API!!! This is such good news.
Save your enthusiasm for after it launches; Google's got a habit of over-promising when it comes to AI.
Everything they published thus far in the generative AI space has been abysmal in quality compared to the competition. I'd be hella surprised if this reaches GPT-4 levels of quality...
I'm a GPT4 subscriber and a Google GSuite work subscriber. I've been using the latest Bard this morning to write and refine python code, and it's just as good if not slightly better than GPT4. I asked it to refine some obtuse code with lots of chaining, and it did an admirable job writing accurate comments and explaining the chained logic. It's ridiculously anecdotal of course, but I used Bard for all of 5 minutes last time they announced. This time seems different.
Manifold has this at 69%, so here's an opportunity to take some people's internet points: https://manifold.markets/brubsby/will-googles-gemini-beat-gp...
Looks like it's 75%? It briefly dropped to 68% in October/November, but has been fairly consistently around 75% for a while.
2 replies →
I’m curious which instances of overpromising you’re referring to.
Like how much they hyped up Bard, which when released turned out to be barely competitive with GPT3.5. E.g. https://www.reuters.com/technology/google-ai-chatbot-bard-of...
I definitely think GPT is better than Bard, but Bard definitely did live up to the hype in a few ways. The two that blew my mind (and still do to some extent) are the blazing speed and the ability to pull information real time (no more pesky knowledge cutoff date). Bard also felt pretty comparable to 3.5 to me, better in some things and worse in others. Coding was definitely a bust with Bard.
1 reply →
I do not recall Bard being said to be better than any particular other model, but then having worse performance by some metric when released.
Your link isn’t really an indication of an overpromise.
Bard isn't a model, it's a product. Saying comparisons against "Bard" without specifying a particular point in time are like analyses of "ChatGPT" without specifying a model. There have been a number of releases adding more features, tool use, making it smarter, and crucially adding more languages. ChatGPT is not fine-tuned in different languages – it manages them but lacks cultural context. That's one place Bard is quite far ahead from what I've seen.
4 replies →
In terms of AI? Last year? A better question is what wasn't an overpromise?