Comment by lukaslalinsky
1 day ago
I don't know if it's Gemini CLI or Gemini 2.5 Pro, but the combination is not even comparable to Claude Code with Sonnet. I was starting with these agent tools several weeks ago, so it was very tempting to use Gemini, instead of paying for Claude Pro, but the difference is huge. In my experience, Gemini was very quick to get stuck in debugging loop, fixing something "one last time" over and over again. Or it got into writing code, despite my explicitly saying not to do so. I'm still trying to figure out if I could use Gemini for something, but every time I try it, I regret it. Claude Code with GLM-4.5 is a good alternative to paying for Claude Pro, it's not as good as Sonnet, but close.
I guess what seems surprising to me is that Gemini 2.5 Pro scores well above Claude Sonnet on Aider's leaderboard, even beating Claude Opus 4.
I have been kinda wondering if there's something that just isn't as good between the CLI and model because the Gemini CLI has been a mostly frustrating experience - and it's kept me from wanting to pay for Claude because I don't want to pay money for the same frustrating experience. But maybe I should try Claude and see.
https://aider.chat/docs/leaderboards/