Comment by didibus
5 days ago
The CFO or wtv that tweeted, their argument was, if you allow cheap free competitive models, you will stop the influx of capital in frontier development of even more powerful LLMs, thus capping how far the tech could reach. Obviously, they're mostly asking for regulation to save their money, but it seems their argument is that without an environment that rewards the development of the next frontier model the tech might not evolve as fast.
> if you allow cheap free competitive models, you will stop the influx of capital in frontier development of even more powerful LLMs, thus capping how far the tech could reach
Hmm. So either the weights are open for all to use, or nobody trains those weights at all? Sounds like the ideal outcome to me.
The worst possible outcome is the one where frontier labs train godlike AIs then kick the ladder out from under them. That should be prevented at all costs. No country or corporation can ever be allowed to win the AI race, for technofeudalism will follow swiftly after. As long as they keep competing with each other, we're the winners. If that music ever stops, it's time to watch out.
I'd rather have AIs achieve sentience and wipe out humanity as a whole than live in a world where they submit to the whims of gigacorporations and totalitarian governments for the sole purpose of efficiently oppressing me and keeping me in line while they enjoy riches and freedom I'll never have.
> it seems their argument is that without an environment that rewards the development of the next frontier model the tech might not evolve as fast.
This is precisely what the people worried about AI risk and job displacement want, so they should be strongly in favor of open weights then, right?
> This is precisely what the people worried about AI risk and job displacement want, so they should be strongly in favor of open weights then, right?
I'm getting a "gotcha" vibe from how you worded the question, but the answer -unironically - is "Yes." Anyone who is not a closed-weight AIaaS provider[0] will have their lot significantly improved by equally capable, open-weight models.
0. Or their investors. I'm surprised to see Y Combinator signed this letter sering their holding in OpenAI is worth billions and hasn't IPO'd yet. I suspect they crunched some numbers first before signing.
Edit: I realized another group that may be unhappy with frontier open-weight models are those who believe LLMs are inchoate super-intelligences; not only do I disagree with them, but if they are correct, I don't see why we should trust trillion-dollar corporations and their out-of-touch CEOs with that responsibility, when countless CEOs have shown time and time again, that they are not aligned with humanity's interests.
There are two subsets of that group who tend to oppose open weights:
1) The people who think LLMs are "inchoate super-intelligences", but then your argument is entirely correct and they should be happier to see less exuberant development of the things than to make sure the rapid advancement of the world-destroying technology is locked up inside corporate entities that are themselves poorly-aligned. So these people either don't actually exist or are making an honest mistake and should update.
2) Disingenuous sock puppets who pretend to be the first group because they want regulatory capture and know that "we need to regulate this because it's unsafe" sells more tickets than "we need to regulate this to exclude competitors and drive up margins".
1 reply →
> thus capping how far the tech could reach
I just don’t buy it. There’s still gonna be demand for stronger models. Sure growth will be slower, but this might even drive a push for more cost efficient training / inference and/or new architectures if money is harder to come by.
Yeah, I agree with this take. When there's less capital floating around it will make these labs prioritize shrinking the models so less hardware (or older hardware) is needed to run a model with the same or similar capabilities. They'll have to do that simply because the cost of running the models will become more important.
It also might end up pushing us towards LLM ASICs assuming the model progress slows significantly.
> There’s still gonna be demand for stronger models.
potential issue is those will be Chinese models if they win, which could be national security matter.
Which is kind of weird, imo. Shouldn't increased competition spur increased investment? If your competitor's product is approaching or beating yours on some metric, isn't the answer to improve your product to differentiate it from the competition? To say that open weight models will stop the flow of capital seems to indicate one of two things: 1) the frontier labs have no idea how to compete, so they are giving up; or 2) they figure that investors will eventually shrug and say "eh, the open weight stuff is good enough, no need to do more research," and retreat from the industry altogether. In the former case, it makes sense to lobby for regulation because the alternative is failure. In the latter, it's an admission that their product has no differentiating qualities from any other in the category and the product is more like a commodity or a utility and not a machine to print infinite wealth.
How about: excellent technology will demand premium prices, and hence will have the capital to back it ... horseshit technology will die a death, and any horseshit capital that backed it.
Opening up will make things more efficient and at least give said horseshit capital a chance at being redeployed elsewhere a slightly higher chance of being successful.
VCs have been horseshit for some time and throwing money at horseshit startups to increase their AUM, their incentive structures are fundamentally misaligned with their clients.
Isn't that why Americans pay so much more for their medicine and drugs so the rest of the world can get them cheaper.