Comment by kcb
7 hours ago
You really think China doesn't have massive amounts of capital expenditure related to AI? They're actively bootstrapping an entire chip industry.... https://www.reuters.com/world/china/china-prepares-295-billi...
7 hours ago
You really think China doesn't have massive amounts of capital expenditure related to AI? They're actively bootstrapping an entire chip industry.... https://www.reuters.com/world/china/china-prepares-295-billi...
Relatives vs absolutes. America will spend $500B and because of leaky pipes that's effectively 100B going directly to what's needed. China gets a lot of bang for their buck so even if they're spending a fraction of the US, they make it worth their money.
I believe China has leaky pipes as well.
That's true for domestic labor and manufacturing, like shipbuilding, but the bleeding edge chips only come from one place and the US labs get the best while Chinese labs do not (unless they smuggle them). China gets creative, sure, but it can't overcome the fundamental issue that the US labs have more magic rocks that do math faster than their magic rocks. And the current state of the art is to just "do more math".
Nvidia GPUs aren't even the absolute SOTA for LLM inference anymore. Some labs are moving to ASICs and Huawei already have their own custom chips running DeepSeek as we speak.
There's enough money and scale on the line that software affinity like CUDA is no longer the deciding factor and there's margin for custom stacks.
Even more so after the USA GPU exports ban which is proving to have backfired by speeding up China's tech growth.
China’s chip industry is 7-10 years behind, and that is because they are desperate and have been throwing money at it. But technological progress requires more than just money.
Jensen said the Huawei Ascend 950 is roughly comparable to the NVidia H200[1]
The H200 was released Nov 2024.
Even allowing for Jensen exaggerating the risk there is no way China is 7-10 years behind.
Looking at manufacturing process nodes, SMIC N+3 is a a 5nm process. 5nm was introduced by Samsung and TSMC in 2020 so at most that is 6 years.
But the chips they can produce on it are roughly comparable to "roughly level with Android flagships from three years ago"[2]
TL;DR: China is more like 2-4 years behind than 7-10 years. If China developed EUV lithography then all bets are off.
[1] https://www.reddit.com/r/LocalLLaMA/comments/1kxw6b9/nvidia_... - see video.
[2] https://www.tomshardware.com/tech-industry/semiconductors/se...
2-4 years is enough to lock them out of the race.
3 replies →