Comment by hhh
2 days ago
Why? Almost all of the open source models end up actually sucking for general purpose use, and require a decent bit of effort to even make remotely usable for specialized use cases.
2 days ago
Why? Almost all of the open source models end up actually sucking for general purpose use, and require a decent bit of effort to even make remotely usable for specialized use cases.
From what I could tell (Corridor Digital mentioned this as well), actual pros use local models through ComfyUI, rather than prompting these proprietary models.
Control and consistency, as well as support for specialized workflows is more important, even if it comes at the expense of model quality.
Corridor Digital is also pretty despicable.
Why do you say that? I feel like such strong blanket statements at least warrant an explanation.
Because from what I understand, the whole premise of billionaires giving AI all their money is
1. AI succeeds and this success is defined by they will be able to raise prices really high
2. AI fails and receives a bailout
But if there are alternatives I can run locally, they can't raise prices as high because at some point I'd rather run stuff locally even if not state of the art. Like personally, USD 200 a month is already too expensive if you ask me.
And the prices can only go up, right?
not really, in a scenario where demand dies down surplus gpu compute becomes so under-utilized we would see it drop even lower I would think. Prices will go up of course if we keep seeing more tokens needed to solve problems, and demand keeps going up with no increase in efficiency or capacity, which is again not what we're seeing really.
You are saying it needs at most minor tweaks when used for something specific like a product support channel?
For the long-term value of a horribly overpriced and debt ridden corporation it matters quite a lot if the catch up of open source to adequate is less than a decade in instead of several decades in some uses and a few more in others.
There's two scenarios going forward that I can see.
Either there's a massive reduction of inference and training costs due to new discoveries and then those big hardware hoarders have no moat anymore or nothing new is discovered and they won't be able to scale forward.
Either way it doesn't sound good for them.
At the moment. AI company management is not so myopic and can see the risk that this could change.
FYI there are no open source models, only open weights. Open source means you get source code.
yes there are completely open models -- look at Allen AI and others