Comment by dofm
20 hours ago
> The people saying that local models can easily replace the real Frontier Models from Anthropic or OpenAI are just not using it for the same things you and I do.
> They seem to be happy with their small usages.
Oh yes, we're terribly inferior people. Just living on scraps from the masters' tables.
It wasn't meant as a dismissive comment.
I do plenty of experiments of things i always wanted to do and they just don't work with local models.
Finetuning of some ML models for a specific usecase, some 4k demo idea i had, small browser games to show others game mechanic ideas i had for ages, analysis tools etc.
Even just playing around with some Ghidra eats context like nothing.
[flagged]
I really strongly agree with this statement. A bunch of people aren't even engineers, and their abilities aren't that good either, yet they keep saying that open-source models can replace OpenAI or Anthropic's models.
If that were really the case, basically nobody would spend so much money using them.
Putting aside that you're "really strongly" agreeing with a personally directed insult:
You should factor in that undeniably most people don't have the means to run even a 27B dense model locally, and therefore do not actually know what they are and are not capable of in that context.
And you might want to look at openrouter's rankings.
If you are comfortable automatically assuming that "doesn't use Claude or Codex" is equivalent to "not a good engineer" or "bad engineer", then I think you are probably lost to more nuanced discussions.
4 replies →
Ahh yes. Those are the only two options.