Comment by yipinwong
6 hours ago
Doesn't mean jack without access to it.
I used to defend Google's models months ago, but switched to Luna for less intelligent models.
But with this bs of not making it even public, pushing off release of newer models late, I lost faith in Google.
yeah, IMO AA should be excluding unreleased models from their benches or risk becoming an irrelevant marketing platform that no one uses anymore.
It has already become irrelevant to anyone paying attention. Raw scores at published benchmarks mean next to nothing in modern use. They are either gamed to hell or unsolved to the point where differences can be explained by randomness. Speed, cost per token, tokens per task and hallucination levels are the useful axes you can compare along these days if you're not doing scientific frontier level research.
They probably prefer being used by the deep-pocketed organizations that have access to Gemini 4 Carbon even if it means losing the entire rest of the market.
They've only recently emerged as something people reference and now they're already dying.
Curious what was the source of faith you previously had?
I was promoting Google models (more like Google ecosystem) for what Google was doing with their models. Making it accessible to non-technical people (which is what I am doing).
e.g. NotebookLLM was one that got me interested in Google's ecosystem. It was easy to use and explain even to my parents.
Now, their models (and NoteBookLLM merging to Gemini, making it extremely hard for non-tech people and other stuff) release very slowly, their models lie their ass off, very politically skewed, etc.
Yeah. It is vaporware at this stage.
Also, their tooling still is complete shit. I'll not be forced to use Antigravity thing even if it is available and clearly better than Opus or Astra. Their subscription is useless. API can be used with anything you got but that's gonna cost.
Not to mention blocking API usage with subs.
I never use any google models for any agent work any more, in case they block me.
Started migrating gdrive, and gmail to other providers at this point after horror stories in HN, that they lost access to their gmails, etc.
How the fuck can something that was announced less than a day ago be "vaporware".
I have a car that is better than Elon's, it actually does 2 backflips, my friend saw it happen. Will be released soon.
Prove me wrong.
5 replies →