Comment by dgellow

6 hours ago

> Lastly it's the only "SOTA" model in a long time that has actively hallucinated details

Could you expand on this? I’ve never seen a frontier model that doesn’t hallucinate details fairly often, what do you mean by “actively” here?

I mean this specifically for general tasks, like personal research. Small stuff. I was asking for espresso machine recommendations and it literally came up with a non-existent machine that supposedly met all my requirements. I've never seen that with ChatGPT, Claude or Kimi. It's quite surprising how it did that _after_ doing a Google search.

  • Gemini has been like that forever. Even when given the full manual of my bread baking machine, it still gave me the wrong program number; when I was lost at the airport, it gave me completely false directions, etc. Neither ChatGPT nor Claude has let me down like that in recent years.

    The only thing Gemini has over those is integration with my Google account, which is genuinely useful. But I reckon Google could release open weights for their whole product line without affecting market share much.