Comment by arjie
3 hours ago
Gemini team has a long history of releasing great benchmark charts and disappearing into the ether. There has never been a moment where I have preferred them to Claude/Codex. When I get access I eval them on my home assistant set, a small coder benchmark, etc. and they are too expensive, and too low quality.
The benefit for Google is their chat interface has privileged access to their data (maps, etc.) but their model itself is low quality and, if I'm being honest, has the promotion-oriented measurable-output bias that FAANGs tend to have. The later Llamas had the same problem.
About to say the same... even with the "Gemini AI Plus" plan that should be renamed to "Gemini Flash" because you are only allowed to use "the mangled model" using it for something as basic as taking notes and saving to google keep or even google docs, heck yeah a simple "add this to my calendar" completly fails in gemini... Gemini sucks for everything even its own google apps... Claude and Codex even DeepSeek and Kimi are milestones better than anything Google has launched.
It is unfortunate that having such an amazing engineers that are capable to solve any leetcode exercise in 5 minutes on the spot with a white board, they aren't able to even deliver something useful on the AI space.