Comment by GodelNumbering
1 month ago
In the first paragraph,
> Anyone who has read my past writing should know that I don’t regard such bans as a useful measure,
Later (on banning chip sales to china)
> we should crack down on the rampant smuggling and workarounds used to obtain access to such chips.
If you truly believe that bans don't work, the same applies to hardware too.
Furthermore, Dario says later "To address these concerns, I do support the following three measures...": 1. ban chip sales to China 2. crack down on distillation 3. all capable models should go through mandatory safety testing
Just so happens that all these moves commercially benefit Anthropic. If Dario really wanted to make a point, it would land a lot better had Anthropic released a single open-weights model
Bans on Chinese open weight models being used in the US and bans on AI chips and semiconductor manufacturing equipment being exported to China are two extremely different things, and it's not inconsistent in any way to oppose one and endorse another.
> bans on AI chips and semiconductor manufacturing equipment being exported
In some ways, a ban on semiconductor manufacturing equipment exports is also a good way to keep the price of consumer electronics and other goods that depends on memory high because of the potentially decade+ long shortage of RAM we're looking at. I wonder how people here would explain to someone outside the tech bubble how it's good, actually, that those prices keep rising because it means we're preventing China from getting better at AI.
It's good because I have not written a line of code nor thought for myself in a whole year man. And yet I can still get YC money don't you see?
Banning hardware is helping China in the long run though. And long is not actually very long. They will beat 'the west' (even though they are all made in the east now) in semiconductors because of this nonsense within 50 years. And also in AI capabilities. Making capable adversaries more competitive and angry is often not really a great strategy.
Nvidia CEO had a viral rant about this, implying they don’t really have a moat against China other than Chinese researchers _prefer_ to stay in the CUDA ecosystem. If you force them out then they are capable of building their own chips and ecosystem which may become the new industry standard outside America. He didn’t say this explicitly due to his role but implied that it can be easier than it looks and it’s more of a resource allocation problem.
2 replies →
is it export if they take control of the entire island manufacturing it.
banning export is short sighted and doesnt address any problem at a scale longer than months or maybe at most a few years.
The export controls on chips have been in place for many years at this point.
And China has invested immensely in sovereign chip industry for a long time and is still incredibly behind.
5 replies →
> is it export if they take control of the entire island manufacturing it.
If.
> If you truly believe that bans don't work, the same applies to hardware too.
No, software and hardware are different. You can very plausibly prevent smuggling of physical objects, and you very obviously cannot prevent smuggling/diffusion of open source bits-on-disk.
> software and hardware are different
No, because both can be banned using laws and Dario is against banning. It doesn't matter if you smuggle or not, law can outright ban it.
Exactly, compare banning books to banning guns.
At this point, Anthropic releasing a sonnet 4.x class open weights model would be a positive PR move that doesn’t affect their bottom line.
+1 and this will really be a good move. Open weights models are not going anywhere the focus should now shift to hardware and compute. Compute needs to be optimized for LLMs, currently they are inefficient. Analog computing like ReRAM should get more focus.
They will never do this because it will reveal way more about their other model architectures than they would ever be willing to do. I mean really why the hell are we mad at a company for not wanting to open source their IP? do you think Meta is going to release their ad targeting algorithms? Or google is going to release their search rank algorithms. i mean these things are multi trillion dollar pieces of IP.
I get Anthropic is being really sleazy and annoying here, but being mad at them for not releasing an open weight model i think is unreasonable.
Certainly not demanding they open source any IP that might give their competitors an edge. Rather I’m saying that pulling a gpt-oss-120b would a good PR move right about now.
That would go against the narrative they built over the years, that open weight models are dangerous because they will end up telling you how to create a biological weapon that will destroy the world
Exactly, the letter will make much more sense if they are releasing open weight models and China is distilling their models and keep them in secrets for evil purpose
Banning software/data from being put on the internet vs banning GPU hardware is fundamentally different though, isn't it?
How so?
There are many possible international producers, it doesn't need to be physically transported, every household could near-instantly have a copy, it puts local business at a disadvantage if they can't use the same tools as international, etc.
You don’t see how it is easier to regulate physical objects than it is to regulate bits of information?
1 reply →
Banning hardware and banning software are very different things, and the latter is orders of magnitude easier than the former. Physical and non-physical things are different!
Carl Wheezer from Temu, what a clown...
>all these moves commercially benefit Anthropic.
From a new "fast" company arising, you can sometimes see the way that before it started up there was nothing but "narrative" and that is what established the initial business model since there was nothing else yet. After some momentum is gained whether there is a pivot or not then the narrative going forward has to be aligned with the now more-well-proven business model.
From his leadership standpoint there are 3 big recommendations right now. That's what this message is all about.
>We should not sell powerful chips or chipmaking equipment to China
Well you and who else?
If there's not already somebody who is compromising the well-being of a nation in exchange for a handful of gold, with the ever-incresing glorification of greed & dishonesty at all costs it's only a matter of time for this one.
>We should crack down on industrial-scale distillation operations. Distillation is a much more compute-efficient process
Wait a minute, what's always been needed by everybody are more compute-efficient processes for everything. I've mentioned this before and it's been a while but back in 1980 it took less than a year to figure out I was going to need other chips that were not regular CPUs if I was going to get the most intelligent response from the silicon on a single square-foot of PCB. At the same time it was obvious you were never going to get far without what they now call "distillation", especially with only kilobytes of memory. Otherwise you would be wasting such stupidly large amounts of memory & storage there was no way you could really call it "intelligent". Now with ML & AI on the rise again there are so many people more deeply immersed than ever, and nothing has really contradicted these basic concepts yet, which have been easily recognizable since like forever.
>All sufficiently capable models, open and closed, should go through mandatory safety testing. The best way to address threat #2 is to just directly test models for cyber, biological, and alignment risks before release.
Righteous concept, and I'm always in favor of 100x the amount of testing in general normally done.
But "just" test says it pretty well, and those who are gifted enough to "draw the rest of the owl" freehand can test things the most skillfully until they are blue in the face. It's not going to help if an adversary decides not to test, or to enhance these exact things so it can have some kind of competitive advantage. Amodei does not ignore this and there is a footnote about it.
People realize that some of the elements that are coming to mind were expressed in some fairly early "science-fiction" so all this is nothing new
Still looking for the most intelligent responses I can get, since way before 1980 ;)
TL;DR: We like money, and Anthropic should stay in a position to make loads of it despite any competition.
That's more or less how China has historically treated its competition. The CCP has routinely intervened to give their country's corporate interests an advantage.
Up until a few years ago, if you wanted to sell a car as a non-Chinese company in China, you had to hand over pretty much everything to a local company and go into business with them.
When Google wanted to operate an uncensored search engine in China, they found themselves hacked.
It's not altogether unusual for IP to be transferred to Chinese manufacturers for production under a license agreement, then to find goods made with that IP to be for sale for far cheaper without payment made through the licensing agreement. Or maybe they just don't bother with a licensing agreement at all and do counterfeit products straight-up.
There are more examples but turnabout is ultimately fair play.
I mean so has the US... look at all the trade deals that has happened over the last 20, 30... 50 years between the US and the rest of the world. There has always been pressure to help the American corporations, be it copyright law, banning encryption, or outright pressuring other countries not to invest in their own tech and instead use US companies. Look at the current state of Europe for example; lots of people blame the governments, and while its true they take the decisions, a lot of them where encouraged by the US.
> We like money, and Anthropic should stay in a position to make loads of it despite any competition.
In a position to lose loads of money, maybe.
Even without China eating their lunch, there's zero reason to believe Anthropic will ever be profitable.
They might just merge with OpenAI. Right now it seems they are still working out who might come out on top but they are both burning tons of money and essentially offer the exact same product up to some minor differences, economically it makes much more sense for them to collude instead of compete for the same market. They might be colluding already for all we know. If they manage to push out foreign competitors they can probably divvy up the Western market quite profitably as their domestic competitors would have less than 20 % (?) market share together?
3 replies →
> In a position to lose loads of money, maybe.
you can say you're pre-revenue and you're a potential pure play
2 replies →
The hammer is open weight models, and the anvil is Apple's m7 chips with higher memory bandwidth