Comment by mlsu
2 hours ago
When they surpass us, they will surpass us hard, in a way that is nearly impossible for us to compete with them.
Training and serving LLM's is massively parallel. Your bottleneck is either in energy or chips. China will catch up on chips fully decades before we catch up on energy. Arguably, this is already happening: here in the USA, we have lots of chips, but we are seeing our electricity bills skyrocket as more datacenters come online. We are powering those datacenters with natural gas turbines, not solar, wind and nuclear. Right now, to purchase one of those, you are on a 5-year waitlist. There's your timeline!
China is invested, from a regulatory, cultural, workforce, strategic, and technological standpoint, in an energy abundant future. We are not invested -- and in fact, actively sabotaging ourselves -- on all of those fronts.
Once they acquire chips, we lose, basically permanently. Look at what Huawei is doing recently and what is on their roadmap to understand how fast this catching-up is taking place. I'm sure that David Sacks would say that our innovation motor is pulling their copycat caboose along, as our monopolist tech companies steam ahead towards the frontier. I am not so sure. They are already ahead of us in many technologies. Speaking of technologies, they're building natural gas turbines in house, starting in 2025.
No comments yet
Contribute on Hacker News ↗