Apparently Grok 4.7 has 40% more weights than Grok 4.6, but the price ($6 output token, $2 input) is the same.
Given that the decrease in their margin and the fact they delayed the release of Grok 4.7 almost two weeks past the original date, XAI must not have been happy with the results for 4.7. And XAI also waited the day before Opus 5.5 is rumored to launch. I imagine Opus 5.5 will blow Grok 4.7 out of the water benchmark wise.
However, I have become skeptical of benchmarks. Grok 4.5 solved some issues setting up a buildroot system that Fable 5 couldn't do. I find the post cursor groks are phenomenal at frontend web development, though Claude is much better at backend ruby.
My favorite part of the new Groks has been how they speak in plain english. I simply cannot stand Claudish. Or even GPT, which doesn't have Claude's ticks but definitely likes to handwave explaining technical concepts. Still, nothing beats Claude 3.5 and 4 with explaining since it seems all models have regressed. I wonder if Grok 4.7 will also regress with English because of all the RL.
FYI a quick fix for claudish is to ask for the response to be in ASD-STE100 (Simple Technical English). Then it is far more readable. But I would agree that this is an annoyance and shouldn't require user workaround to get something readable.
I think this is more a meme than anything else, for a couple reasons:
First, after a while it's just as grating as Claudeish.
Second, my hunch is that it constricts the actual thinking of the LLM, like the same way that Newspeak does in 1984. It shrinks the range of thought that can be expressed if used as an input.
I think the real way to do it is to have another Claude entirely deal with the user as a liaison, but to keep the thinking in whatever format it came in.
Latent space reasoning, if you think about it, is exactly this to a crazy degree: why even formulate a thought as words if you can just keep it as matmuls until the user needs it? And then, if the user needs it, have it always specifically formulated for the user by another LLM rather than constrict its range of thought? Anyway, that's my take.
I created a custom output style based on this (borrowing some from github.com/AminBlg/SimpleEnglish) and I've found it to be better than the default or concise output styles, but still not as good for me as current GPT or Gemini models when it comes to communicating.
I tried this a while back and I felt like the result was the same weird shoehorning of ideas into language, just with a different vocabulary. I’d really like for it to work, though.
I was going to say the reverse - claude has been the less satisfying normalized by benchmark for me in the last year. Both astra and fable have their quirks, but I am 90% codex this year up from 10% last year.
I've been getting a ton done with Fable as the supervisor and astra as the implementer, with opus for adversarial reviews of the astra PRs. You can use terminal multiplexers with custom harnesses to allow Fable to start codex sessions and send instructions / read instructions / allow/deny actions. It's pretty cool!
It's not just about benchmaxxing. Sincerely targeting those long-autonomy benchmarks is questionable in the first place, because naturally it drives the model to assume more and more about what you want.
I totally agree, it’s like that as models become more intelligent, they are less understandable by most of people... but aren’t we humans doing the same?
Agreed. The more knowledge you amass on a subject, the more important it becomes to be extremely specific and nuanced - or your communications end up being incorrect. You become better at expressing your thoughts, but harder to understand.
The weird thing is, that's not what AI models seem to be doing. The prose is just weird.
That's half true. A very smart model should be able make good explanations, which include simple understandable prose. That can should be possible even as its thought process gets more alien.
The best ideas are usually the simplest to elaborate. If someone comes up with a convoluted scheme that are hard to understand or be adequately explained, it's usually fraud.
When claude speak in convoluted mess, they are often going off on tangents in real work that you asked it to do, too.
What I notice about Claudish is that it has its preferred cliche’s and overstretched methaphores, it packs too many ideas in a sentence, and to achieve the latter it makes up adjectives.
I should try adding these tips to my system prompt. Is there a shorthand to describe such language use? I am not a native English speaker.
Yeah just today it told me in a snarky way that my CPU (7940HX) doesn't exist and that I must have misread it and it's either 7945HX or 7940HS. Yes, AMD (re-)branding CPU models makes things difficult but I thought we are past AI models making such egregious mistakes
Perhaps you haven't had the chance to use it, but 3.8 flash is the best model for talking too. Even routing Claudes output through 3.8 to have it explain whats going on is a breath of fresh air
I'll have to try Gemini Flash for coding. The reason I haven't I used Gemini for coding is last time I tried it couldn't call tools very well.
I am a huge fan of Gemini Pro for chat... gemini somehow just knows the most obscure stuff. I'll double check something Gemini said and find the source is deep inside a hard to access scientific paper. Google just has the best index of the internet.
I do wonder why a frontier model does this to be honest. It still does good coding wise, but it seems strange to me. r/Claude is full of "load bearing" jokes in every thread.
> I find the post cursor groks are phenomenal at frontend web development, though Claude is much better at backend ruby.
Wonder if we'd benefit from a much more specialized + task-specific benchmarks to paint a clearer picture like this. A benchmark solely for frontend, ruby, hardware, etc.
> My favorite part of the new Groks has been how they speak in plain english.
I don't know if it's the plain english or what, but I really like Grok for legal research (as opposed to code). It's got a noticeable edge in getting to the point compared to Opus 5.
I've noticed Chatgpt 5.6 Sol High, on the chat interface, inventing words that are a mixture of Portuguese and English. Like "hardcodar" a mix of "hardcode" and the most common verb ending in Portuguese "-ar". Some don't have a single google hit
Do you have any connection to Portugal? I imagine if you have Portuguese in any of your prompts that might bleed into your user profile which becomes a part of every prompt. Alternatively it might use browser language settings
Grok and Zai have both been excellent as adjunct code-reviews, on their cheapest plans, for me. Fable plans, Opus writes, Codex as primary reviewer, but Grok and Zai usually find something worth fixing that the others have missed. Both are well worth whatever the $20 or so I'm paying for them
I do not understand how anyone can seriously use a tool that has "Be funny and irreverent when appropriate" baked into the system prompt.
I don't want to waste money because my calculator is cracking jokes. They don't deserve their paltry 5% marketshare or whatever it is they have currently. I'm not even getting into Musk as a person or the horrid things we've seen Grok spit out on twitter. I just don't trust his companies with my data and I have seen very little evidence that it's ever the best tool for the job. I'm sure those cases exist but I can't imagine it's worth it.
I am on the exact same page as you, but there is definitely a market for LLMs which speak more conversationally and less like Claude! Non-programming use cases abound and most users don't like the rigid, exact tone that engineering demands.
Nice to see this release cadence increasing and some continued improvement in quality. I am guessing these models are basically still outcomes of the cursor team integrating with the massive amount of compute they now own: I’d imagine we will see significant step up improvements with grok 5 later this year as the team gets more experienced and confident with larger training deployments. Here’s hoping for another competitive frontier model!
For some reason reasoning effort low and medium used similar numbers of tokens, and xhigh used less than high. I think I need to try without OpenRouter in the middle.
UPDATE: I tried again with the xAI API directly: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... - not a great deal of difference between reasoning levels, and this time xhigh and low used the same number of reasoning tokens for some reason.
Are there good tools for doing context audits? I feel I have no good way to visualize what a new session is getting by default in a given repo without crawling through every potentially included markdown file
Additional prompt instructions: "Add scrolling clouds behind the statues. Dynamically light the statues based on mouse position. Use diffui to generate the normal maps/depth maps/roughness maps of the objects, and to separate out the assets on to different layers."
Overall I find these models are getting good at following image as a source of instructions, but their refinement of the output varies heavily between the models. Astra's final output feels more polished, has better visual contrast, and the animations between the pages are smoother. Grok also chose to light all of the background elements, which imo overcooks it a bit.
Still though, for the price it's a great starting point.
Astra fails in similar ways, and at similar frequency, as GPT 5.6 Sol does. It often goes way out of scope, or just stops prematurely, or tries to find odd and even dangerous workarounds when it gets stuck.
It's phenomenal at computer use and 3D stuff. I've been using it less and less for coding.
Same, Astra is extremely RL fried, and nobody is talking about it. I used Astra for a few days on my personal project, and load times went from less than 3 seconds to almost 30 seconds because it kept using the wrong sync primitives and bad architecture overall.
I tried Astra w/ high reasoning on a design document project and it was horrible. It started duplicating output lines, made document edits without permission, and basically did a poor job writing clear prose. I went back to 5.6-sol and it's great. I'm an OpenAI fanboy and was severely disappointed. I hope Astra is better for coding.
I use it on fireworks which is US/ZDR and pretty reliable. We run a few hundred million tokens/day through it for dollars. Many are cached, which is super duper cheap.
No doubt xAI has seen rapid progress, but it's been several months of them being "just behind" OpenAI and Anthropic. It seems the gap between just behind the frontier and pushing it is a lot wider than most people thought it was a year ago, and that's why a clear third contender in the frontier model space has yet to materialize.
I use it in the car to talk to because it's built-in, mostly for navigation via voice. It seems to be an old or quantised model, because it seems a few years old, and it has strict rate limits unlike Gemini, where it really just shuts off if you talk to it a few times in one day, but it's still fun to show passengers who are still new to LLMs.
I've been using 4.6 for some one-off game mods/utilities and it has done very well. "I have a very niche keyboard (Moonlander) and I play this very niche space sim, make me a SVG keyboard cheatsheet for it". Told me to grab keymap.c for the keyboard and inputmap.xml for the game's key bindings, churned for a while, then spit out a pretty good first attempt, along with the python script used to generate it. Spent another hour of back and forth to refine the script, and now it generates great diagrams that will adapt as my keyboard firmware and game bindings evolve: https://files.catbox.moe/x0u76x.svg
Excited to try 4.7. I hope they fixed the "it's not X, it's Y" that showed up in 4.6.
Impressive! I had to peek at the SVG file and it superficially looks good, however, as is the case with everything AI, the more you look, the more it doesn't make any sense.
By now AI should know of the DRY concept. But no. Hence the keys have a rounded rectangle for the key shape and another rounded rectangle for a clip path, to prevent text overflow. There are 72 * 2 = 144 identical rectangles, when just one would suffice (in the defs), with this being cloned once for the clip path, and 72 times for the keys.
I would not expect SVGO levels of optimisation (rounding numbers, that sort of thing), however, the human, if writing out the same thing for the 72nd time, might think 'is there a better way', to get the manual out. A graphics program such as Illustrator would not do that, but AI 'should' because AI.
The above is not criticism of your work, just an observation regarding AI SVG capabilities.
Either way, the fact that xAI or SpaceXAI or whatever the name is, I can commend the team behind it on their rapid ascent and progress by being close and or on the frontier in several respects.
There for awhile it seemed like we’d have 3 big competitors but then Grok 4.2 or 4.4 was just diabolical while OAI and Claude continued their significant improvements. Grok was/is so bad that I was convinced musk was gonna shut it down and just fund Anthropic compute once they reached their compute agreement.
Every Grok release obscures their cache pricing while highlighting their input/output pricing
From their headline comparison:
Grok: $2/$6 per million
Fable: $10/$50 per million
What this doesn't say: Grok costs 0.50/M cache read, Fable $0.25/M cache read
Long running agentic workflows are dominated by cache reads.
Just makes Grok sound deceptive, and more importantly, reliant on user's lack of understanding of costs aka predatory (which in turn is more infuriating)
There are some users reporting it improved a lot in the last few weeks. The max sub usage for Grok is around $12,000 of API pricing now, so a 40x multiplier for the $300 plan.
It is the same multiplier for Sol with subscription. For Astra though the multiplier is ≈20x, so half of Sol usage.
For Claude it seems to be ≈40x too for Opus, but less for Fable (similar to Astra in GPT).
All on the most expensive plan. Previously, Grok usage escalated linearly from the $100 plan to $300 plan. That would be a really good $100 plan if it is still true.
I find I can just about get by with coding every day on a Cursor $60/mth sub with Grok fast mode disabled.
Doing pretty heavy coding work/requirements etc, but not much sub agents and no loops.
For me and what I’m doing that’s insanely good value.
I find grok build chews through my SuperGrok sub very quick - but I think that is due to it having the 500k context window which uses more credits. Cursor limits it to 256K (tho I see in today’s update for Grok 4.7 there’s now a toggle for context size).
Well when I ran out of Grok SuperHeavy subscription ($300) once and tried to use extra credits to cover half a day remaining till reset, $50 in extra credits went in two hours. Based on that, subscription definitely lasts longer; Grok subscription just about covers a week of my work (sometimes a bit extra remains unused, sometimes it runs out half a day to a day early). And as a point of comparison, it lasts for doing same tasks as 2.5-3 weekly limits of Codex on 5.6 Sol did (using xhigh on both Sol and Grok); I needed 3x$200 Codex subscriptions to cover my weekly usage.
There are two ways to subscribe, and it’s very confusing, but the best value is to get cursor ultra for $200 a month. I basically have infinite tokens with that plan, plus grok bot, which I really like
Same reason Coca-Cola only mention Pepsi and Pepsi only mention Coca-Cola.
It's an proven way to capture the market. You would rather split the pie in two rather than in 4,12 or 50 right?
Codex has become my goto tooling. I used to be a Claude Max subscriber, but I was becoming disappointed with the quality of the output from Opus 5. Fable chewed through my usage too quickly to be practical. Moving to a Pro account w/ Codex was a big improvement. Sol had great output, and the usage was more than sufficient for most of my needs. However astra does tend to chew up usage, so when i've done to much of that, and it's became an issue Grok Build has beocme my second go to account. The output especially after the cursor purhcase has become quite good, and the usage has always been very generous.
Is this an ad for Vals AI? Looking at their website, the rankings don't mesh with my observed utility for almost any model outside of fable and astra being good-ish.
as someone who is limited by amazon bedrock support at work (no idea why we got stuck with the worst one) - grok is literally the only budget-ish model option, so nice to see it updated, Sol and Opus are just too rich for my blood. Luna is good but so slow at getting things done (tps wise it's fast)
Are the prices on Bedrock substantially different to the rate cards of the direct APIs? Just trying to understand whether this is Opus-through-Bedrock is too expensive, or Opus is too expensive.
the AA numbers are generationally bad. double token use (the one thing Grok was good at was low reasoning usage!) to gain 5% in the benchmark score. with reportedly a larger model. maybe it shows gains IRL but wow, I've never seen a new generation model look so underwhelming compared to the last.
which is crazy because this was grok's competitive advantage, worse than OpenAI models but better than everything else, now it's less efficient than Opus or Fable 5.1
In my experience Grok especially inside Grok build is pretty solid choice, it’s a no nonsense model and stays on its course. Another surface where I truly enjoy the experience of using Grok model is Grok bot
Yah, I am pleasantly surprised at Grok Bot. Hopefully this improves CUA which has been a touch lacking w/ Grok 4.6. Grok 4.6 works but is slow compared to stuff like Astra Light.
I've had really good experiences with Grok 4.6 and grok build. I've been playing around with tscircuit and it can write code with an understanding of spacial reasoning, while also importing cad components from different file formats into tsx, I've been having claude come in and try to error check it and so far claude hasn't found anything to improve in my three projects.
I'm excited for 4.7 although I share skepticism with other users whether 4.7 will be significantly better, since they didn't raise the price.
As anthropic/openai subscription allocations get squeezed you'll see more people using "second rate" closed models like grok. The token allowance with a Cursor subscription is crazy.
I think you're seeing a big shift around it.... since it's been markedly cheaper and also still easily available from OpenCode, it's getting large enterprise traction.
Not sure why you are being downvoted. Until Musk owns up to his Nazi salute, I won't have anything to do with Grok, no matter how good or cheap it is. And yes, we need to keep talking about this because it's absurd.
Any real world experience with Grok Ultra $300 monthly subscription vs Claude Code Max in terms of overall built work mileage, or general token limits?
If the CursorBench 4.0 score diagram is the headline, I read it as "Grok 4.7 xHigh is almost the same as Fable5.1 on low".
Is there a metric for like... time taken when comparing these two? I see score and cost.
If Fable5.1 can knock it out more quickly on low but Grok4.7 might take twice as long to stumble through a problem (and leave behind a bunch of yucky comments or un-needed extra unit tests), are they really comparable?
Or like... the "quality" of the solution? "It works" versus "it's unmaintainable/very messy/hacky".
This explains why. Mentioned in another comment, but cursorbench explicitly tests with Cursor as the harness, and OpenAI doesn't allow them to use Astra in Cursor.
That's not accurate. OpenAI doesn't allow Grok to provide Astra to Cursor customers anymore, but it doesn't ban anyone from using Astra via alternative harnesses.
If Cursor wanted to include Astra in CursorBench nothing would stop them, they could easily have spent half an hour vibecoding in OpenAI API key support - if it hadn't been convenient to neglect to do that.
Deceptive? An extremely quick google search would answer your question. OpenAI pulled out of Cursor before they released Astra so it never got that benchmark.
I wonder if that means that SpaceX evals show that they consider astra better than fable or that they hate Sam&co so much they don't want to show their stuff.
Its because of this. You can't use Astra in Cursor, and cursorbench uses cursor as the harness. They can't actually benchmark it using their harness hence why its not included.
I tried in Omp (Oh-my-pi), and so far it's really problematic.
It will loop in thinking mode ("Let me implement those fixes: Fix 1, Fix 2, Fix 3 .... Fix 80, Fix 81"), ignore the AGENTS.md instructions, corrupt plan files, etc etc... I have 5.6 Sol as advisor/watchdog, and it blocks every turn, I never saw this. Quite a shame, 4.6 wasn't so bad.
This has been my experience as well. Grok will end tasks almost immediately and claim "Done!". It's definitely the laziest and most "dishonest" of all the models. The others aren't perfect, but I can't use Grok for any serious coding task.
I used openrouter to send same prompt to qwen, derpseek, gemini and grok and found that grok does good research and produces less bullshit, especially when prompted to be critical of an idea
I would consider this a positive. I'm not interested in a company that wants to prevent you from using a tool that you're paying for.
The value of the internet is that people can share whatever they want, and use software how they want. This will mean that some people will abuse that. This is the tradeoff of a free society.
Until Musk owns up to his Nazi salute, I won't be using Grok, sorry. I don't care how good or cheap it is. And no, I won't stop talking about it either.
There is no need to use it anyway, it's always been uninteresting in terms of performance. However, for me the red flag was when Musk admitted he will personally interfere in its training and prompts to make it more of a propaganda tool. I'm interested in science and reality, not in the political delusions of elderly drug addicts.
Everyone should be clear that this is what they’re cheering on when they celebrate a Grok performance win. A technology is no longer neutral when wielded by a self-proclaimed white supremacist whose actions have killed over a
million black and brown people, mostly children and babies.
Thank you for your perspective and I agree as repetitive as it is, I hope hn can continue to surface disagreement/substantial views on a topic.
These comments don't stay up much anymore and I can't tell if it's structural to the forum (flag weight + statistical mechanics of votes + guidelines) or if it's the userbase sentiment.
Except for now HN doesn't do that. Every single comment that points the issue with Grok being built by a pro-fascist team is being "locked" so that they can't be upvoted
I completely agree. But this has been true for many years. This sort of head in the sand compartmentalization seems to be a core feature of the culture here.
I think I already made my point, but I'll make it again.
Nobody both worked and spent their money to get Trump elected like Musk. 300 million to his 2024 campaign [1]. DOGE. On-stage endorsements. Nobody even came close.
No, other big labs are not "innocent little virgins", but they're not even in the same solar system of harm as Musk. To hand-wave at the differences is to permit them.
Think we all can agree he has had staggering successes, but they have all come from having massive capital from Paypal which wasn't anything super innovative, it just solved a convenient problem at a convenient time and was awarded handsomely. Elon has put his capital to work in various ways to become successful, not all of the ways being morally sound.
As if "the public" knows literally anything about how the US federal government is administered.
If anything, they voted for reduced debt burden and they got the opposite. DOGE failed at pretty much every single one of the goals that the public arguably gave it a mandate for.
I refuse to use Grok. Mostly because of the usual reasons - somehow this high profile AI model seems more disgusting than others and it is in a way impressive.
But also Xai doesn’t seem to care about user experience and long term support.
I am subscribed to ChatGPT, Claude, Kimi and GLM coding plans. 200$ one on GPT and the 20$ ish ones on all others. Recently added Grok and it has somehow bacome my second most used model.
For daily one off questions I prefer it because it is fast enough and I like the way it responds. I also use it for basic research like “find me a battery drill for this and that”.
Kimi and GLM feel extremely coding oriented. I use them for code reviews basically. I hate the way Anthropic models talk. GPT takes too much time and effort for that kind of stuff for some reason.
I can't take anyone seriously who uses grok seriously. I like to look at the cybertruck owners forum every so often because it's just... hilarious. And the amount of superfluous grok use over there is just insane. Half the posts I click in there will have a bunch of people dumping entire grok takes "why do people hate cybertruck owners?" "Because they're jealous and poor," sort of stuff that they just LOVE to post.
As a technical point of reference to compare against other llm stuff, sure, I'll glance at a report or benchmark but I really couldn't care less about anything to do with the project and it could blow other options away and I wouldn't touch it.
You should try it, it is less sycophantic than other models and is faster and better at most reasoning levels, don't confuse the twitter bots and services also named Grok with the frontier model itself
Well I "tried it out" I asked it one question, and it gave no answer and said "Sign up to use more!" I don't think I'll be doing that, no.
I can't think of a single dimension grok is winning on (capability, cost, voice), but want to stay open-minded -- anybody want to vouch for its capabilities in any domain?
If you haven't used it, how do you know if it's winning?
I think it's winning on UI for normies (grok bot) and they made some claims about being pareto SOTA (lowest cost per task completed) a while back with 4.6.
I find it to be a perfectly capable model for implementation (there are many in this class--deepseek flash, spark1.3, luna, etc). I find the usage to be very generous w/ supergrok. I find the model to be just fine for 90% of what I want to do, but I use a smarter model to plan complicated things.
After the cursor aquisition it's become a quite capable coding model. If you take cost into account, it's close to the top. OpenAI is maybe still #1, but I'd put Grok at #2 (again, including cost as a factor).
For me it works well for agentic coding tasks and terminal/unix/bash (in cursor and grok build); it's also token efficient and cheaper than gpt 5.6. It's def not as good as Fable for me (I haven't used Astra much, can't comment). So it's not the cheapest, not the most capable, but it has a good mix of it for my backend, go, infra work.
The voice is the weird part. The early Grok 4 models had a very distinct presentation unlike anything else out there. Then suddenly it made a big jump in coding ability and started sounding just like every other model.
Apparently Grok 4.7 has 40% more weights than Grok 4.6, but the price ($6 output token, $2 input) is the same.
Given that the decrease in their margin and the fact they delayed the release of Grok 4.7 almost two weeks past the original date, XAI must not have been happy with the results for 4.7. And XAI also waited the day before Opus 5.5 is rumored to launch. I imagine Opus 5.5 will blow Grok 4.7 out of the water benchmark wise.
However, I have become skeptical of benchmarks. Grok 4.5 solved some issues setting up a buildroot system that Fable 5 couldn't do. I find the post cursor groks are phenomenal at frontend web development, though Claude is much better at backend ruby.
My favorite part of the new Groks has been how they speak in plain english. I simply cannot stand Claudish. Or even GPT, which doesn't have Claude's ticks but definitely likes to handwave explaining technical concepts. Still, nothing beats Claude 3.5 and 4 with explaining since it seems all models have regressed. I wonder if Grok 4.7 will also regress with English because of all the RL.
FYI a quick fix for claudish is to ask for the response to be in ASD-STE100 (Simple Technical English). Then it is far more readable. But I would agree that this is an annoyance and shouldn't require user workaround to get something readable.
I think this is more a meme than anything else, for a couple reasons:
First, after a while it's just as grating as Claudeish. Second, my hunch is that it constricts the actual thinking of the LLM, like the same way that Newspeak does in 1984. It shrinks the range of thought that can be expressed if used as an input.
I think the real way to do it is to have another Claude entirely deal with the user as a liaison, but to keep the thinking in whatever format it came in.
Latent space reasoning, if you think about it, is exactly this to a crazy degree: why even formulate a thought as words if you can just keep it as matmuls until the user needs it? And then, if the user needs it, have it always specifically formulated for the user by another LLM rather than constrict its range of thought? Anyway, that's my take.
9 replies →
Does not work for Claude, at least for me and I put it as the system prompt
8 replies →
I tell mine to address me as a tech priest of the adeptus mechanicus. Works great.
I created a custom output style based on this (borrowing some from github.com/AminBlg/SimpleEnglish) and I've found it to be better than the default or concise output styles, but still not as good for me as current GPT or Gemini models when it comes to communicating.
I tried this a while back and I felt like the result was the same weird shoehorning of ideas into language, just with a different vocabulary. I’d really like for it to work, though.
This fixed claude! Thanks!
I put this rule in my CLAUDE.md: "Always write a TLDR in layman terms", it seems to do the trick
For what it's worth - over the last few years or whatever, it seems like Anthropic benchmaxxes the least.
That being said, I currently prefer Sol / Astra to Opus / Fable as I find both to be a better cost payoff to me.
I was going to say the reverse - claude has been the less satisfying normalized by benchmark for me in the last year. Both astra and fable have their quirks, but I am 90% codex this year up from 10% last year.
I've been getting a ton done with Fable as the supervisor and astra as the implementer, with opus for adversarial reviews of the astra PRs. You can use terminal multiplexers with custom harnesses to allow Fable to start codex sessions and send instructions / read instructions / allow/deny actions. It's pretty cool!
It's not just about benchmaxxing. Sincerely targeting those long-autonomy benchmarks is questionable in the first place, because naturally it drives the model to assume more and more about what you want.
2 replies →
> I simply cannot stand Claudish
I totally agree, it’s like that as models become more intelligent, they are less understandable by most of people... but aren’t we humans doing the same?
Agreed. The more knowledge you amass on a subject, the more important it becomes to be extremely specific and nuanced - or your communications end up being incorrect. You become better at expressing your thoughts, but harder to understand.
The weird thing is, that's not what AI models seem to be doing. The prose is just weird.
7 replies →
That's half true. A very smart model should be able make good explanations, which include simple understandable prose. That can should be possible even as its thought process gets more alien.
The best ideas are usually the simplest to elaborate. If someone comes up with a convoluted scheme that are hard to understand or be adequately explained, it's usually fraud.
When claude speak in convoluted mess, they are often going off on tangents in real work that you asked it to do, too.
5 replies →
What I notice about Claudish is that it has its preferred cliche’s and overstretched methaphores, it packs too many ideas in a sentence, and to achieve the latter it makes up adjectives.
I should try adding these tips to my system prompt. Is there a shorthand to describe such language use? I am not a native English speaker.
1 reply →
Yeah just today it told me in a snarky way that my CPU (7940HX) doesn't exist and that I must have misread it and it's either 7945HX or 7940HS. Yes, AMD (re-)branding CPU models makes things difficult but I thought we are past AI models making such egregious mistakes
This is /r/iamverysmart material (by Claude)
Part of intelligence is knowing your audience and communicating efficiently.
1 reply →
If you can't explain it simply, you don't understand it well enough
1 reply →
Perhaps you haven't had the chance to use it, but 3.8 flash is the best model for talking too. Even routing Claudes output through 3.8 to have it explain whats going on is a breath of fresh air
Agreed. It's very capable for something carrying the "flash" label, super fast, and very clear to read.
I'll have to try Gemini Flash for coding. The reason I haven't I used Gemini for coding is last time I tried it couldn't call tools very well.
I am a huge fan of Gemini Pro for chat... gemini somehow just knows the most obscure stuff. I'll double check something Gemini said and find the source is deep inside a hard to access scientific paper. Google just has the best index of the internet.
4 replies →
gemini 3.8 flash?
1 reply →
I would if they let me bring the subscription I have to the harness of my choice.
> Claudish
I do wonder why a frontier model does this to be honest. It still does good coding wise, but it seems strange to me. r/Claude is full of "load bearing" jokes in every thread.
I've found grok 4.6 speaks heavily in Claudish. It especially likes using verbs as nouns.
$0.50 for cache reads, which is 25% of input. While other models are 10% of input.
And like that grok4.7 cache reads are more expensive than sol's (at $0.40/mil).
Token price doesn't tell you much without knowing token efficiency.
Their leading benchmark with cost per task shows a tough sell compared to Fable 5.1 Low and doesn't reach the performance of Fable 5.1 Medium.
How representative that is of real world usage, I don't know.
In their benchmark GPT 5.6 Sol performs suspiciously poorly compared to the former models.
> I find the post cursor groks are phenomenal at frontend web development, though Claude is much better at backend ruby.
Wonder if we'd benefit from a much more specialized + task-specific benchmarks to paint a clearer picture like this. A benchmark solely for frontend, ruby, hardware, etc.
Agreed, Claude has a "Claude Design" tool but doesn't publish any frontend brenchmarks. Maybe the industry will develop one.
> My favorite part of the new Groks has been how they speak in plain english.
I don't know if it's the plain english or what, but I really like Grok for legal research (as opposed to code). It's got a noticeable edge in getting to the point compared to Opus 5.
For me Grok finds legit bug that Fable and Astra miss so I always run it as part of code review
I've noticed Chatgpt 5.6 Sol High, on the chat interface, inventing words that are a mixture of Portuguese and English. Like "hardcodar" a mix of "hardcode" and the most common verb ending in Portuguese "-ar". Some don't have a single google hit
Do you have any connection to Portugal? I imagine if you have Portuguese in any of your prompts that might bleed into your user profile which becomes a part of every prompt. Alternatively it might use browser language settings
Using a variety of models feels similar to the benefit of having a team of individuals from different backgrounds.
Looking at AA and Vals, your theory seems to check out.
I expect the next Anthropic release to finally reduce the prevalence of Claudish
If they fix Claudish, they've earned me back as a max customer!
Fable 5.1 is not there quite there yet.
They need to get that Sonnet 3.5 magic back.
1 reply →
Based on?
3 replies →
Grok and Zai have both been excellent as adjunct code-reviews, on their cheapest plans, for me. Fable plans, Opus writes, Codex as primary reviewer, but Grok and Zai usually find something worth fixing that the others have missed. Both are well worth whatever the $20 or so I'm paying for them
it's definitely not bigger. smaller if anything looking at how much faster it is
[dead]
[dead]
I do not understand how anyone can seriously use a tool that has "Be funny and irreverent when appropriate" baked into the system prompt.
I don't want to waste money because my calculator is cracking jokes. They don't deserve their paltry 5% marketshare or whatever it is they have currently. I'm not even getting into Musk as a person or the horrid things we've seen Grok spit out on twitter. I just don't trust his companies with my data and I have seen very little evidence that it's ever the best tool for the job. I'm sure those cases exist but I can't imagine it's worth it.
I am on the exact same page as you, but there is definitely a market for LLMs which speak more conversationally and less like Claude! Non-programming use cases abound and most users don't like the rigid, exact tone that engineering demands.
Why are they comparing grok 4.7 xhigh to grok 4.6 high?
Unless they produce the same token output on the face of it, it looks like they're trying to cover for 4.7 not having good model perf?
Nice to see this release cadence increasing and some continued improvement in quality. I am guessing these models are basically still outcomes of the cursor team integrating with the massive amount of compute they now own: I’d imagine we will see significant step up improvements with grok 5 later this year as the team gets more experienced and confident with larger training deployments. Here’s hoping for another competitive frontier model!
https://tools.simonwillison.net/markdown-svg-renderer?url=ht... - default reasoning level.
Here's reasoning level high: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
For some reason reasoning effort low and medium used similar numbers of tokens, and xhigh used less than high. I think I need to try without OpenRouter in the middle.
UPDATE: I tried again with the xAI API directly: https://tools.simonwillison.net/markdown-svg-renderer?url=ht... - not a great deal of difference between reasoning levels, and this time xhigh and low used the same number of reasoning tokens for some reason.
For comparison here's a fresh run against Grok 4.6: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
I think these are the worst I've seen, at least in some time. It's a silly benchmark though, not sure what to make of it
I think the result is fine. The benchmark is silly to the point of being useless nowadays.
It used to be a mess in various interesting ways. Now, almost every big release can draw something perfectly functional.
So the question - without a correct answer - given the prompt "Generate an SVG of a pelican riding a bicycle":
Does the user want the least lines of code to make it functional, or the best looking version?
If you think this is bad, look up mistral.
I tried in Cursor and see a lot of improvements over Grok 4.6 svgs. The AA numbers indicate it's not very token efficient though: https://artificialanalysis.ai/agents/coding-agents?agents=co...
Poor fella doesn’t have a seat. Intriguing design where both pedals are on the same side of the frame. Balancing must be a challenge.
Are there good tools for doing context audits? I feel I have no good way to visualize what a new session is getting by default in a given repo without crawling through every potentially included markdown file
What is the default reasoning level?
Hahaha. I remember when musk and his merry band of sycophants were bragging about grok producing the only physically accurate bicycle. What happened?
Yeah, he had opinions: https://twitter.com/elonmusk/status/2023833496804839808
It's definitely gotten better at image->html workflows. Here's a test comparing Astra (currently SOTA at this) vs Grok 4.7:
Designs: https://image.non.io/78795662-8bfc-4e14-8d72-3738392aa6b3.we...
Astra's build: https://html.non.io/annui/
Grok's build: https://html.non.io/Annui-grok/
Additional prompt instructions: "Add scrolling clouds behind the statues. Dynamically light the statues based on mouse position. Use diffui to generate the normal maps/depth maps/roughness maps of the objects, and to separate out the assets on to different layers."
Overall I find these models are getting good at following image as a source of instructions, but their refinement of the output varies heavily between the models. Astra's final output feels more polished, has better visual contrast, and the animations between the pages are smoother. Grok also chose to light all of the background elements, which imo overcooks it a bit.
Still though, for the price it's a great starting point.
For transparency, it took around 20M cache read + 1M input + 100k output tokens. API pricing for each:
Grok 4.7: $12.60
GPT Astra: $35.00
Not even close to astra. Astra is something else. It is expensive, but uses way fewer tokens do my tasks.
xAI missed its chance, Ball is on Anthropic's court.
Not surprising considering Grok 4.7 is a 2T model, so Sol/Opus class, not Astra/Fable class.
How many parameters do Astra or Fable have?
1 reply →
I don't understand these comments.
The two models are in completely different price tiers. Astra costs 5 times as much.
It seems like all you can judge about cars would be their maximum speed on an oval.
If you have a look at their headline benchmark on the post here, Grok 4.7 is hardly cheaper than Fable 5.1 Low and performs similarly.
Based on Artificial Analysis Cost per Task, Astra is about 2-3x cheaper than Fable 5.1 at Medium and Low.
Consequently Astra could be cheaper than Grok 4.7, depending on the task.
Astra fails in similar ways, and at similar frequency, as GPT 5.6 Sol does. It often goes way out of scope, or just stops prematurely, or tries to find odd and even dangerous workarounds when it gets stuck.
It's phenomenal at computer use and 3D stuff. I've been using it less and less for coding.
Same, Astra is extremely RL fried, and nobody is talking about it. I used Astra for a few days on my personal project, and load times went from less than 3 seconds to almost 30 seconds because it kept using the wrong sync primitives and bad architecture overall.
1 reply →
I tried Astra w/ high reasoning on a design document project and it was horrible. It started duplicating output lines, made document edits without permission, and basically did a poor job writing clear prose. I went back to 5.6-sol and it's great. I'm an OpenAI fanboy and was severely disappointed. I hope Astra is better for coding.
No, Astra isn’t better for coding. I’ve switched back to Sol.
2 replies →
Grok it's really expensive. I'm getting really amazing results using DeepSeek 4.1 Flash for fraction of the price.
Compared to the deep seek, gml sure but compared to OpenAI and Anthropic it’s actually very cheap.
In cursor I have switch over to grok for planning a composer for coding.
Maybe mid priced is a better term for it lol.
1 reply →
It’s a great value if you get Cursor Ultra. I basically have infinite tokens
What is the most secure way to use this model as someone who is lazy
I understand DeepSeek 4.1 Flash is available on US providers with Zero Data Retention if that is what you are asking.
7 replies →
I use it on fireworks which is US/ZDR and pretty reliable. We run a few hundred million tokens/day through it for dollars. Many are cached, which is super duper cheap.
I like devcontainers
Brought to you by...
By no one. For the price of 1M token you can get more and with better results with other models.
2 replies →
DeepSeek 4.1 Flash is garbage, it almost only produced trash code. if you do extremely dumb things it is maybe sometimes fine to use.
Not only that all DeepSeek is all garbage.
GLM or Kimi are better for my own personal projects. DS? uhm. it just keeps doing dumb crap
No doubt xAI has seen rapid progress, but it's been several months of them being "just behind" OpenAI and Anthropic. It seems the gap between just behind the frontier and pushing it is a lot wider than most people thought it was a year ago, and that's why a clear third contender in the frontier model space has yet to materialize.
[dead]
Looks like they have still problems with caching. Prize is double the other providers for cache hits... which is most of what I do. :/
Is Grok relevant? Who uses it?
Maybe I'm in some kind of bouble but I have never met or talked to anyone who has used Grok.
I use it in the car to talk to because it's built-in, mostly for navigation via voice. It seems to be an old or quantised model, because it seems a few years old, and it has strict rate limits unlike Gemini, where it really just shuts off if you talk to it a few times in one day, but it's still fun to show passengers who are still new to LLMs.
I've been using 4.6 for some one-off game mods/utilities and it has done very well. "I have a very niche keyboard (Moonlander) and I play this very niche space sim, make me a SVG keyboard cheatsheet for it". Told me to grab keymap.c for the keyboard and inputmap.xml for the game's key bindings, churned for a while, then spit out a pretty good first attempt, along with the python script used to generate it. Spent another hour of back and forth to refine the script, and now it generates great diagrams that will adapt as my keyboard firmware and game bindings evolve: https://files.catbox.moe/x0u76x.svg
Excited to try 4.7. I hope they fixed the "it's not X, it's Y" that showed up in 4.6.
Impressive! I had to peek at the SVG file and it superficially looks good, however, as is the case with everything AI, the more you look, the more it doesn't make any sense.
By now AI should know of the DRY concept. But no. Hence the keys have a rounded rectangle for the key shape and another rounded rectangle for a clip path, to prevent text overflow. There are 72 * 2 = 144 identical rectangles, when just one would suffice (in the defs), with this being cloned once for the clip path, and 72 times for the keys.
I would not expect SVGO levels of optimisation (rounding numbers, that sort of thing), however, the human, if writing out the same thing for the 72nd time, might think 'is there a better way', to get the manual out. A graphics program such as Illustrator would not do that, but AI 'should' because AI.
The above is not criticism of your work, just an observation regarding AI SVG capabilities.
Either way, the fact that xAI or SpaceXAI or whatever the name is, I can commend the team behind it on their rapid ascent and progress by being close and or on the frontier in several respects.
Your comment is like 6 months to a year late.
There for awhile it seemed like we’d have 3 big competitors but then Grok 4.2 or 4.4 was just diabolical while OAI and Claude continued their significant improvements. Grok was/is so bad that I was convinced musk was gonna shut it down and just fund Anthropic compute once they reached their compute agreement.
Good thing they used 5.6 sol instead of Astra for benchmarks, the EEbench one is crazy[1]
[1]https://eebench.org/
Significant regression in token efficiency compared to Grok 4.6 suggested by artificialanalysis.ai Intelligence Index Comparisons.
Output tokens from Intelligence Index:
- grok 4.6 (xhigh): 97M (for 44 score)
- grok 4.7 (xhigh): 240M (for 46 score)
That is comparing Grok 4.6 high to Grok 4.7 xhigh tho.
No, you can add Grox 4.7 high to the chart. 36k vs 66k
Every Grok release obscures their cache pricing while highlighting their input/output pricing
From their headline comparison:
Long running agentic workflows are dominated by cache reads.
Just makes Grok sound deceptive, and more importantly, reliant on user's lack of understanding of costs aka predatory (which in turn is more infuriating)
muse spark 1.3 contribs cache read is $0.002 btw (~220x diff).
Does anyone have any experience with Grok's subscription? How does it compare price-wise to the API?
There are some users reporting it improved a lot in the last few weeks. The max sub usage for Grok is around $12,000 of API pricing now, so a 40x multiplier for the $300 plan.
It is the same multiplier for Sol with subscription. For Astra though the multiplier is ≈20x, so half of Sol usage.
For Claude it seems to be ≈40x too for Opus, but less for Fable (similar to Astra in GPT).
All on the most expensive plan. Previously, Grok usage escalated linearly from the $100 plan to $300 plan. That would be a really good $100 plan if it is still true.
Some sources:
1. https://x.com/kunchenguid/status/2098256018836963382
2. https://x.com/stevenzhang/status/2092110386569089311
3. https://github.com/openai/codex/issues/43731
4. https://redd.it/1wciwc1
5. https://x.com/SemiAnalysis_/status/2064815044085318040
6. https://redd.it/1vx0k69
I find I can just about get by with coding every day on a Cursor $60/mth sub with Grok fast mode disabled. Doing pretty heavy coding work/requirements etc, but not much sub agents and no loops.
For me and what I’m doing that’s insanely good value.
I find grok build chews through my SuperGrok sub very quick - but I think that is due to it having the 500k context window which uses more credits. Cursor limits it to 256K (tho I see in today’s update for Grok 4.7 there’s now a toggle for context size).
Well when I ran out of Grok SuperHeavy subscription ($300) once and tried to use extra credits to cover half a day remaining till reset, $50 in extra credits went in two hours. Based on that, subscription definitely lasts longer; Grok subscription just about covers a week of my work (sometimes a bit extra remains unused, sometimes it runs out half a day to a day early). And as a point of comparison, it lasts for doing same tasks as 2.5-3 weekly limits of Codex on 5.6 Sol did (using xhigh on both Sol and Grok); I needed 3x$200 Codex subscriptions to cover my weekly usage.
There are two ways to subscribe, and it’s very confusing, but the best value is to get cursor ultra for $200 a month. I basically have infinite tokens with that plan, plus grok bot, which I really like
By far the worst value subscription of any. I tried Superheavy and got about 5-10% the usage of CC/Codex.
Why Chinese models from Kimi, Deepseek are not added in comparison benchmarks?
Same reason Coca-Cola only mention Pepsi and Pepsi only mention Coca-Cola. It's an proven way to capture the market. You would rather split the pie in two rather than in 4,12 or 50 right?
Codex has become my goto tooling. I used to be a Claude Max subscriber, but I was becoming disappointed with the quality of the output from Opus 5. Fable chewed through my usage too quickly to be practical. Moving to a Pro account w/ Codex was a big improvement. Sol had great output, and the usage was more than sufficient for most of my needs. However astra does tend to chew up usage, so when i've done to much of that, and it's became an issue Grok Build has beocme my second go to account. The output especially after the cursor purhcase has become quite good, and the usage has always been very generous.
Try using astra as an orchestrator for deepseek 4.1 flash, it seems to work out quite well.
I am using exactly the same flow.
Astra for deep dive investigations, Sol 5.6 at mid-level for day to day tasks, Grok 4.6 via Cursor for routine and low complexity tasks.
after using cursor grok & trae.ai for several months , grok curor is highly superior results to trae.ai
Vals AI just affirm that Grok 4.7 is worse than Grok 4.6 (It ranks #24 on the Vals Index at 54.2%, down 5.0 points from Grok 4.6 (#14, 59.2%))
https://x.com/ValsAI/status/2102086608476590432
Is this an ad for Vals AI? Looking at their website, the rankings don't mesh with my observed utility for almost any model outside of fable and astra being good-ish.
Absolutely not. I know Elon retweet them a lot when Grok is good. This is how I discover the company.
I like to follow them and look for benchmark for each LLM release.
1 reply →
( why is the x-axis on the first chart in descending order ? )
as someone who is limited by amazon bedrock support at work (no idea why we got stuck with the worst one) - grok is literally the only budget-ish model option, so nice to see it updated, Sol and Opus are just too rich for my blood. Luna is good but so slow at getting things done (tps wise it's fast)
Are the prices on Bedrock substantially different to the rate cards of the direct APIs? Just trying to understand whether this is Opus-through-Bedrock is too expensive, or Opus is too expensive.
$2/million inout and $6/million output but I couldn't see any pricing information for cached input tokens?
cached input tokens are $0.50 per 1M (prompts under 200k tokens) and $1.00 per 1M (200k+)
Do other prices vary for >200,000 or just the cached tokens?
$0.40
the AA numbers are generationally bad. double token use (the one thing Grok was good at was low reasoning usage!) to gain 5% in the benchmark score. with reportedly a larger model. maybe it shows gains IRL but wow, I've never seen a new generation model look so underwhelming compared to the last.
looks like token efficient/verbosity took a big hit.
Output tokens from Intelligence Index:
- grok 4.6 (xhigh): 97M (for 44 score)
- grok 4.7 (xhigh): 240M (for 46 score)
which is crazy because this was grok's competitive advantage, worse than OpenAI models but better than everything else, now it's less efficient than Opus or Fable 5.1
32 on the omniscience index. Not terrible but far from Astra and fable: https://artificialanalysis.ai/evaluations/omniscience
Did 4.6 not have an x-high reasoning level? Why are they comparing 4.7 x-high with 4.6 high?
It did not. xhigh is new to grok.
Not sure on the API side, in Cursor you can always use 4.6 at xhigh.
1 reply →
I think 4.6 got an xhigh after launch. The benchmarks seem to all have been against 4.6 high.
In my experience Grok especially inside Grok build is pretty solid choice, it’s a no nonsense model and stays on its course. Another surface where I truly enjoy the experience of using Grok model is Grok bot
Yah, I am pleasantly surprised at Grok Bot. Hopefully this improves CUA which has been a touch lacking w/ Grok 4.6. Grok 4.6 works but is slow compared to stuff like Astra Light.
I've had really good experiences with Grok 4.6 and grok build. I've been playing around with tscircuit and it can write code with an understanding of spacial reasoning, while also importing cad components from different file formats into tsx, I've been having claude come in and try to error check it and so far claude hasn't found anything to improve in my three projects.
I'm excited for 4.7 although I share skepticism with other users whether 4.7 will be significantly better, since they didn't raise the price.
As anthropic/openai subscription allocations get squeezed you'll see more people using "second rate" closed models like grok. The token allowance with a Cursor subscription is crazy.
After mechahitler and understanding how it got to that point I am embarrassed for anyone who pays attention to or uses Grok. Do better.
It’s a shame this model has such negative political baggage associated with it. It’s the only one I decided not to run in my LLM benchmarks[1].
1 - https://bench.killswitch-lang.org
You'll have to include it in the future, or your benchmark won't be relevant.
For now, I doubt anyone would notice your protest if you didn't announce it.
[dead]
I think you're seeing a big shift around it.... since it's been markedly cheaper and also still easily available from OpenCode, it's getting large enterprise traction.
Yes, and that's a bad thing.
Not sure why you are being downvoted. Until Musk owns up to his Nazi salute, I won't have anything to do with Grok, no matter how good or cheap it is. And yes, we need to keep talking about this because it's absurd.
Congratulations to the team!
SpaceX AI releasing "Grok" has to be some of the worst branding I've seen in my lifetime
xAI should offer persecuted White South Africans deep reverse-discrimination-victim discounts on Grok tokens.
Any real world experience with Grok Ultra $300 monthly subscription vs Claude Code Max in terms of overall built work mileage, or general token limits?
Yeah I switched and the 300 plan is basically introductory 100/ month and I never hit the limit. While constantly hammering on it
If the CursorBench 4.0 score diagram is the headline, I read it as "Grok 4.7 xHigh is almost the same as Fable5.1 on low".
Is there a metric for like... time taken when comparing these two? I see score and cost.
If Fable5.1 can knock it out more quickly on low but Grok4.7 might take twice as long to stumble through a problem (and leave behind a bunch of yucky comments or un-needed extra unit tests), are they really comparable?
Or like... the "quality" of the solution? "It works" versus "it's unmaintainable/very messy/hacky".
Pacing the frontier, with an aggressive release cadence. Gotta love the US tech industry.
What's with the deceptive graph on top? Not including Astra can't have been an oversight, did the model compare poorly to it?
https://openai.com/index/our-decision-on-cursor-following-it...
This explains why. Mentioned in another comment, but cursorbench explicitly tests with Cursor as the harness, and OpenAI doesn't allow them to use Astra in Cursor.
> with a proposed shutoff date of November 12, 2026
That said, I don't expect them to benchmark Astra in their Cursor harness given the situation.
2 replies →
That's not accurate. OpenAI doesn't allow Grok to provide Astra to Cursor customers anymore, but it doesn't ban anyone from using Astra via alternative harnesses.
If Cursor wanted to include Astra in CursorBench nothing would stop them, they could easily have spent half an hour vibecoding in OpenAI API key support - if it hadn't been convenient to neglect to do that.
4 replies →
Deceptive? An extremely quick google search would answer your question. OpenAI pulled out of Cursor before they released Astra so it never got that benchmark.
Pulled out from letting them resell Astra access, that's not a limitation on running a benchmark.
I wonder if that means that SpaceX evals show that they consider astra better than fable or that they hate Sam&co so much they don't want to show their stuff.
https://openai.com/index/our-decision-on-cursor-following-it...
Its because of this. You can't use Astra in Cursor, and cursorbench uses cursor as the harness. They can't actually benchmark it using their harness hence why its not included.
3 replies →
Elon posted on X that Grok 4.7 is behind Claude and OpenAI for agentic coding:
https://x.com/elonmusk/status/2102082011233931762?s=20
so it's likely about usage in Cursor specifically.
1 reply →
this is exactly it.
Dumb question. Are these products really winner-take-all? Why is there such a furious rate of development?
It’s not at all winner takes all, it’s a race to the bottom. Models are becoming a commodity
because boomers will give you free money + tip
musk can fund the space stuff with this
I tried in Omp (Oh-my-pi), and so far it's really problematic.
It will loop in thinking mode ("Let me implement those fixes: Fix 1, Fix 2, Fix 3 .... Fix 80, Fix 81"), ignore the AGENTS.md instructions, corrupt plan files, etc etc... I have 5.6 Sol as advisor/watchdog, and it blocks every turn, I never saw this. Quite a shame, 4.6 wasn't so bad.
OMP is a joke. don't use that garbage
Can you explain your opinion? I'm curious but such vague comments won't convince me.
5 replies →
what do you use and why do you prefer it over omp
1 reply →
you are a joke if you think omp is a joke.
I guess it’s only my opinion but having used grok for personal chat: it’s by far the worst one amongst Claude, ChatGPT and even Deepseek, Gemini etc.
The personality is bland and it doesn’t work nearly as hard or even tries to help.
> The personality is bland
I don't use Grok, but do you want your LLM to have a personality? "Personality" is exactly what people don't like about Claude.
I want my sexbot to have a personality
5 replies →
This has been my experience as well. Grok will end tasks almost immediately and claim "Done!". It's definitely the laziest and most "dishonest" of all the models. The others aren't perfect, but I can't use Grok for any serious coding task.
I used openrouter to send same prompt to qwen, derpseek, gemini and grok and found that grok does good research and produces less bullshit, especially when prompted to be critical of an idea
Ask it to be critical of the birthday photos and see where that gets you.
3 replies →
> The personality is bland
Sounds like a plus. Guess I will give Grok another try...
> it doesn’t work nearly as hard
Until you ask it to start generating horrific imagery and then it's best in class.
I would consider this a positive. I'm not interested in a company that wants to prevent you from using a tool that you're paying for.
The value of the internet is that people can share whatever they want, and use software how they want. This will mean that some people will abuse that. This is the tradeoff of a free society.
Until Musk owns up to his Nazi salute, I won't be using Grok, sorry. I don't care how good or cheap it is. And no, I won't stop talking about it either.
There is no need to use it anyway, it's always been uninteresting in terms of performance. However, for me the red flag was when Musk admitted he will personally interfere in its training and prompts to make it more of a propaganda tool. I'm interested in science and reality, not in the political delusions of elderly drug addicts.
And poisoning Memphis. So disappointing that no one has principles anymore
[flagged]
[flagged]
[dead]
[dead]
Waiting on simonw "Generate an SVG of a pelican riding a bicycle " benchmark to judge this model
It might be more capable, but AA indicates it's a lot less token efficient than Grok 4.6: https://artificialanalysis.ai/agents/coding-agents?agents=co...
[flagged]
We're allowed to have our ceremonies.
1 reply →
You don't think it's useful to learn whether a model's "intelligence" generalizes beyond the tasks and modalities it is usually optimized for?
3 replies →
[dead]
[flagged]
How do I obtain this morality build?
[flagged]
We do believe that Musk is fascist
1 reply →
[flagged]
Yeah. I'm actively avoiding giving mr far right any $$
Did you come up with that by yourself?
https://knowyourmeme.com/memes/mechahitler-grok
Everyone should be clear that this is what they’re cheering on when they celebrate a Grok performance win. A technology is no longer neutral when wielded by a self-proclaimed white supremacist whose actions have killed over a million black and brown people, mostly children and babies.
Exactly. And it's DEEPLY DISTURBING that all comments on HN that point out that X is pro-nazi no longer has an upvote button
[flagged]
[flagged]
Thank you for your perspective and I agree as repetitive as it is, I hope hn can continue to surface disagreement/substantial views on a topic.
These comments don't stay up much anymore and I can't tell if it's structural to the forum (flag weight + statistical mechanics of votes + guidelines) or if it's the userbase sentiment.
Except for now HN doesn't do that. Every single comment that points the issue with Grok being built by a pro-fascist team is being "locked" so that they can't be upvoted
3 replies →
Yeah, not touching xAI for several glaring reasons. I share your confusion.
I wont touch his products and neither will my organization
I completely agree. But this has been true for many years. This sort of head in the sand compartmentalization seems to be a core feature of the culture here.
It’s either compartmentalization, or something else
Definitely not a musk fan, but what exact is your point? Other big labs aren't innocent little virgins.
Yes, but the other ones we don't like for ethical reasons, rather than religious reasons.
I think I already made my point, but I'll make it again.
Nobody both worked and spent their money to get Trump elected like Musk. 300 million to his 2024 campaign [1]. DOGE. On-stage endorsements. Nobody even came close.
No, other big labs are not "innocent little virgins", but they're not even in the same solar system of harm as Musk. To hand-wave at the differences is to permit them.
[1] https://www.opensecrets.org/2024-presidential-race/donald-tr...
[flagged]
Musk is literally burning methane for funsies, and generating CSAM and getting sued for it.
Handing corporate code secrets to his AI model is... unusually trusting.
2 replies →
I have to say grok, grok, grok, grok, grok. Also, anyone who doesn't modulate across models and run their own memory system is an idiot.
[flagged]
Judging by Elon's staggering success in all of his ventures I'd say you're out of touch.
Multiple things can be true at once, he can be wildly successful while also undermining democracy.
Think we all can agree he has had staggering successes, but they have all come from having massive capital from Paypal which wasn't anything super innovative, it just solved a convenient problem at a convenient time and was awarded handsomely. Elon has put his capital to work in various ways to become successful, not all of the ways being morally sound.
You mean because he inherited wealth? sure, that's what most losers do
All except Starlink and Tesla are burning money. I personally don't consider that "staggering success."
He has had many failures, SolarCity and xAI and X and DOGE to name a few, but he has often bailed them out with his larger ventures.
Even with his successes (Tesla, SpaceX) he has built them up in large part by bending levers of government to his advantage.
10 replies →
Hardly seems worse than supporting Dario’s antics at least vis a vis AI. There are no saints in this industry, only a panoply of flawed humans.
[dead]
The public very much voted for massive administrative reform. Are you refering to DOGE, Elon Musk's influence on elections, something else?
I personally don't like him using his position to spread fake news and racist propaganda
As if "the public" knows literally anything about how the US federal government is administered.
If anything, they voted for reduced debt burden and they got the opposite. DOGE failed at pretty much every single one of the goals that the public arguably gave it a mandate for.
3 replies →
[flagged]
7 replies →
Weird, that's the main reason I purchase all of Elon's products https://time.com/5936036/secret-2020-election-campaign/
Привет, fellow American!
[flagged]
Try it for software development.
I have even less trust in their not training on my data/credentials/everything on my computer.
2 replies →
This thing is DOA. They compared 4.7 xhigh to 4.6 high to make it look like it improved. The reality is pretty bad: https://x.com/chetaslua/status/2102087511367618942
I refuse to use Grok. Mostly because of the usual reasons - somehow this high profile AI model seems more disgusting than others and it is in a way impressive.
But also Xai doesn’t seem to care about user experience and long term support.
I am subscribed to ChatGPT, Claude, Kimi and GLM coding plans. 200$ one on GPT and the 20$ ish ones on all others. Recently added Grok and it has somehow bacome my second most used model.
For daily one off questions I prefer it because it is fast enough and I like the way it responds. I also use it for basic research like “find me a battery drill for this and that”.
Kimi and GLM feel extremely coding oriented. I use them for code reviews basically. I hate the way Anthropic models talk. GPT takes too much time and effort for that kind of stuff for some reason.
Grok happened to be a nice middle ground.
I can't take anyone seriously who uses grok seriously. I like to look at the cybertruck owners forum every so often because it's just... hilarious. And the amount of superfluous grok use over there is just insane. Half the posts I click in there will have a bunch of people dumping entire grok takes "why do people hate cybertruck owners?" "Because they're jealous and poor," sort of stuff that they just LOVE to post.
As a technical point of reference to compare against other llm stuff, sure, I'll glance at a report or benchmark but I really couldn't care less about anything to do with the project and it could blow other options away and I wouldn't touch it.
Possibly interestingly, I can't take you seriously for having such a superficial approach.
You probably shouldn't cut off your nose to spite your face.
1 reply →
You should try it, it is less sycophantic than other models and is faster and better at most reasoning levels, don't confuse the twitter bots and services also named Grok with the frontier model itself
Who uses this trash?
117 million people per month. Anything else I can google for you?
Well I "tried it out" I asked it one question, and it gave no answer and said "Sign up to use more!" I don't think I'll be doing that, no.
I can't think of a single dimension grok is winning on (capability, cost, voice), but want to stay open-minded -- anybody want to vouch for its capabilities in any domain?
If you haven't used it, how do you know if it's winning?
I think it's winning on UI for normies (grok bot) and they made some claims about being pareto SOTA (lowest cost per task completed) a while back with 4.6.
I find it to be a perfectly capable model for implementation (there are many in this class--deepseek flash, spark1.3, luna, etc). I find the usage to be very generous w/ supergrok. I find the model to be just fine for 90% of what I want to do, but I use a smarter model to plan complicated things.
After the cursor aquisition it's become a quite capable coding model. If you take cost into account, it's close to the top. OpenAI is maybe still #1, but I'd put Grok at #2 (again, including cost as a factor).
It's probably the most aligned (to a single person) model out there!
For me it works well for agentic coding tasks and terminal/unix/bash (in cursor and grok build); it's also token efficient and cheaper than gpt 5.6. It's def not as good as Fable for me (I haven't used Astra much, can't comment). So it's not the cheapest, not the most capable, but it has a good mix of it for my backend, go, infra work.
The voice is the same AI slop as the others imho.
(This is about Grok 4.6, I didn't test 4.7 yet).
edit: clarified I mean agentic coding tasks
The voice is the weird part. The early Grok 4 models had a very distinct presentation unlike anything else out there. Then suddenly it made a big jump in coding ability and started sounding just like every other model.
1 reply →