Comment by dofm
21 hours ago
Putting aside that you're "really strongly" agreeing with a personally directed insult:
You should factor in that undeniably most people don't have the means to run even a 27B dense model locally, and therefore do not actually know what they are and are not capable of in that context.
And you might want to look at openrouter's rankings.
If you are comfortable automatically assuming that "doesn't use Claude or Codex" is equivalent to "not a good engineer" or "bad engineer", then I think you are probably lost to more nuanced discussions.
With my DGX Spark + 5080 + 3060 setup, I've tried all kinds of approaches, including quantization, acceleration, fine-tuning, post-training, and everything else.
It still can't compare to Opus 5.5 max in terms of speed, capability, and stability.
And when I calculate all the money I've invested, directly subscribing to the service would actually be cheaper, more efficient, and more stable.
Open source is great, but don't glorify it.
The architecture of the code I develop has never been simple. If you're someone who doesn't even work on things that need to be deployed to something like k8s, then basically, open-source models are indeed enough for you.
You can sell your DGX Spark for basically no loss. Maybe even make money.
I try local models regularly on 2x 4090 and struggle with context length constantly. 48GB on GPU and 128GB from RAM.
the original comment mentioned only 16GB of VRAM.
You know talk about Open Router and 27B dense model?
We are not comparing an even more expensive Hardwaresetup to run local models with proper context window and parameters.
Can i run some open model on a super expensive Mac Book or co with some kind of okayisch results? Yeah sure but you know what the t/s will be and yeah Frontier is still Frontier and Kimi, GLM, DeepSeek are not Frontier. They lag half a year.
You are not getting Opus 5 or Sonnet at home for now.
Why are you so offended by this?
I'm not offended. I'm also not the person resorting to insults.