Comment by originalvichy
9 days ago
This is the real risk after the slow death of personal computing. Even internet resources like servers will be hoarded by the hyperscalers that are the only ones who can afford to order years of compute hardware in advance.
I’ve already started buying cheap old business PCs just in case I’ll ever need to have simple barebones machines to run things on.
> This is the real risk after the slow death of personal computing.
By the time you can have a slow death of personal computing, capacity will improve and prices will improve.
In the shorter term sitting on an old computer or regressing a couple years on specs or paying an extra $100/$200 for 8GB/16GB works.
> Even internet resources like servers will be hoarded by the hyperscalers that are the only ones who can afford to order years of compute hardware in advance.
I don't see why hyperscalers would be so much better at handling price increases.
For some average business paying a week's wages for the computer you use, they can afford that doubling to two weeks just fine.
For all the normal server rental companies, okay the guy on the $10 plan either pays $16 now or cuts their resource allocation and keeps paying $10. That's not going to cause a sea change. And higher end hosting isn't that much different.
Late reply. This is all assuming that the corps producing the hardware will live in the same world as before this squeeze. The reality is that the combination of a highly concetrated manufacturing landscape + the global political environment means that the same games that were played with ASML, Nvidia and TSMC will likely be repeated with the relatively lightly affected generic manufacturers of components. Given the close connections the hyperscaler CEOs have with the USGov, and the leverage the US has over South Korea and Japan, one executive order is enough to tip over the entire manufacturing sector and supply chain to the hyperscaler’s advantage.
As others noted, only the Chinese sector has a chance to fill the space for consumers in this nightmare scenario.
> By the time you can have a slow death of personal computing, capacity will improve and prices will improve.
I love this baseless optimism. Reminds me of the economic theory (forgot who put it forward): Everything will be fine in the long run.
...and it's rebuked by Maynard Keynes: "We're all dead in the long run".
Yes, by the time capacity & prices will improve, we'll be all dead.
> I don't see why hyperscalers would be so much better at handling price increases.
I'm pretty sure that you don't know how much discount they can get when they order "I'll buy the whole production in Y2027". When first generation EPYC was launched, it didn't reach academic or local datacenters, because AMD sold all production to Hyperscalers and Dropbox back in the day.
Money is always more valuable today than tomorrow, so if you can pay today, you'll get massive discounts.
> I love this baseless optimism. Reminds me of the economic theory (forgot who put it forward): Everything will be fine in the long run.
Seems accurate though, I've already noticed no-name Chinese manufacturers stepping it up, throwing caution and capital to the wind and leaning in as hard they can. Following the typical Chinese model of how they get involved in markets, we're just a couple years away from memory being a market with skyrocketing prices and limited availability to a market where various nations are considering bailouts and tariffs to protect their local manufacturers from dirt-cheap Chinese exports to keep their memory producers from going through what domestic solar panel producers went through (a near extinction level event).
I specifically didn't say disk mfg as well only because I haven't yet noticed a new big spinning HDD Chinese brand. But they're definitely active in the lower end of the DDR5 market.
3 replies →
> ...and it's rebuked by Maynard Keynes: "We're all dead in the long run".
Keynes said that when somebody complained that his theories didn't work in the long run. And the true rebuke is, we're now in the long run and Keynes is dead
> ...and it's rebuked by Maynard Keynes: "We're all dead in the long run".
The trouble with Keynes is that it's only fully true on the time scale of the heat death of the universe, and in that context it's fully nihilistic. Whereas most economic theories do operate on timescales where the finding out comes within the lifetime of the people fucking around. And to the extent that it doesn't, it generally comes within the lifetime of their kids. Meanwhile that quote is used to justify every piece of short-term thinking that screws the next generation to juice this year's numbers.
> When first generation EPYC was launched, it didn't reach academic or local datacenters, because AMD sold all production to Hyperscalers and Dropbox back in the day.
When first generation EPYC was launched, it broke Intel's effective monopoly on performant servers that everyone was eager to get out from under, but the first generation was being fabbed by Global Foundries using the decaying infrastructure being sustained only by the few uncompetitive Opterons nobody had really wanted in years.
It's the example of the thing you're saying doesn't happen. The following generations were fabbed by TSMC who has dramatically more capacity than GF and expanded it even more since EPYC launched, to the point that AMD's share in servers this year is almost 50%, up from ~0% the year before EPYC launched.
> Money is always more valuable today than tomorrow, so if you can pay today, you'll get massive discounts.
The real issue here is capacity planning. It costs billions of dollars to build more fabs so they only do it if they're confident the demand isn't going to crash. But cash-rich customers willing to pay in advance are a good way to do that. You give them a contract that says they pay you now and agree not to dump the hardware into the market if the bubble pops (e.g. customer agrees to maintain possession of the hardware for 3 years after delivery and use only for AI) and then the AI companies are the ones taking the risk instead of the hardware companies, which makes the hardware companies willing to build more fabs. Which in turn is what gets the price back to something ordinary people can afford.
15 replies →
So far its just metastasized not smoothed out. GPUs then RAM then electricity then disk… long way to go till land then sunlight, hope we don’t get there!
Hyperscalers buy so many CPUs and so much RAM they can dictate prices (to a point) or at least make an agreement to buy at a much lower price but buy X amount for the next 5 years.
When the market's so hot I don't see why anyone would give them a particularly big discount. And they would have been getting a discount before, so they probably end up seeing a larger percentage spike in what they have to pay.
Maybe if they're locking in long enough to fund new fab construction? But in that case after a few years a ton of capacity will come online so they're actually helping solve the problem.
I work on a desktop, but as a backup I have bought a refurbished Dell Latitude, there are a lot of decent ones for €250 on eBay. Put Linux on it, it’s good enough for most workloads.
I just hope my top shelf 2020-era desktop doesn’t die on me because it would get very expensive to get a new build these days.
> I just hope my top shelf 2020-era desktop doesn’t die on me because it would get very expensive to get a new build these days.
I could probably sell my gaming rig (12900K, 64GB of DDR5, 4TB NVME, RTX 3090) for more today than what I built it for about 4 years ago, it's absurd. I won't, of course, because it's still glorious for 4K gaming even today. In retrospect, $5000 very well spent.
I have a similar rig, but a 10th gen i7, 128GB of DDR4, 2TB NVMe, and dual RTX 3090s. Built it in 2021 for crypto mining, it ended up paying itself off just before Eth went PoW. I kept it mining even after profitability, because it ran warm enough to heat my apartment leaving my HVAC on fan-only to circulate the heat around.
After winter, I started playing with various other GPU loads until LLMs and SD became easy enough to use. Now it's my experimentation machine.
It's already paid for itself, so anything I sell it for would be profit, but it is still super nice for running local LLMs that power various projects "for free".
You might sell it for more but buying a replacement costs even more so you’re losing money either way. The only way is to sell and never look back.
1 reply →
I did exactly this and suggest it. Used Dell Latitude (the one I got is one from 2019 - model 5300). I put Linux Mint Debian Edition (https://linuxmint.com/download_lmde.php) on it. Works absolutely great.
Small Dell Optiplexes are good for desktop computers.
I got an old hp elitedesk off of eBay, I don’t remember the cpu but it has 8 gig of ram and an ssd. Ubuntu+dokku and it runs all my self hosted stuff.
in the U.S & other regions it sucks cz you can hardly ever get static ip addresses at residential addresses to host things & expose to the internet
It’s almost like the stuff the IPv6 people and the P2P protocol people have said for 25 years was true and correct but nobody listened or cared.
You can use a reverse proxy.
This is a market shock. The reason it doesn't alleviate sooner is the chip manufacturers are very wary of investing billions on capacity that won't come online until after the shock is over and subsequently going bankrupt. Because that's happened before.
IF IT LASTS, capacity will increase.
But it won't last. The AI boom is in exponential growth but it's based on heavy speculation about future value and the bubble will absolutely pop, how agressively depends on how dumb people are about now. The current growth may or may not be entirely justified but it's not sustainable, the free investor money does run out. These back and forth self-dealing deals where companies that own big pieces of each other announce "partnerships" where companies are selling resources essentially to themselves and counting the revenue several times... those are a sign of the approaching peak.
> the free investor money does run out
I've been saying the same thing, but that's why they made the move to IPO, no?
The money always runs out. The dot com bust (Nina Brink forever!) and more recently "let's give a homeless man a 250k mortgage" 2008 bust.
And then?
There are only so many trillion dollar IPOs out there. And then what next?
3 replies →
Is everyone forgetting that even hyper scaler hardware has a finite service life that isn't that long as hardware continues to rapidly improve?
In a few years the second hand market will be flooded
If the hyperscalers demand is persistent, more hardware players will notice and will want a piece of the pie. You already see non traditional players entering.
But what you see is a cautious strategy from the existing players. They are hedging against a bubble. They don’t want to pour today tens of billions of dollars in capacity that they will have to sell it to a deflated market
I’ll wager $5 semiconductor companies are issuing stock to fund capital investment because that’s what you do when these things happen.
> This is the real risk after the slow death of personal computing.
This.
People tend to take things for granted, but the world we've grown up with is not guaranteed to live forever, in twenty years personal computing could look like the personal CD or video tapes collection of the 90s-00s: a thing of the past for most people.
It's quite crazy to imagine personal computing to die. It always felt as a staple, that I could always buy components, that someone would manufacturer them and I could cobble together a machine. But now the prices going so high that it kills the market is... just sad.
I don't think component prices will kill personal computing. Prices used to be far higher in the heyday of personal computing. Millions of people buy phones every two years that cost twice as much as a perfectly capable PC.
Personal computing in the sense of actually controlling our hardware and software will be killed (or rather degraded) by government regulation and platform oligopolies.
> It always felt as a staple, that I could always buy components, that someone would manufacturer them and I could cobble together a machine.
I feel the same. But at the same time the generalization of laptops (with custom motherboard, and soldered parts) and smartphones (custom SoC) means this is already a niche thing. Gamers were the last mass market for upgradeable modular deskops, but a sufficiently long hardware drought would most likely make game editors way more resource conscious, which may kill this niche entirely.
Personal computing is already dead. We use locked down mobile endpoints that run pre-approved thin client software connecting to giant mainframes over monopolized radio networks.
1 reply →
> I’ve already started buying cheap old business PCs just in case I’ll ever need to have simple barebones machines to run things on.
Hmmmm...
That's a bit dramatic. I did buy a few SSDs when RAM prices started going up for I didn't want to be facing a shortage of SSDs but China is already very busy at producing cheap server motherboards: gone are the days where he only option for a server motherboard was a $1000 one. There are ultra cheap, and fully functional, chinese motherboards now.
I'm totally convinced China is not going to sit doing nothing: if RAM prices goes up and there's a business opportunity, China is going to seize it and start producing lots of RAM.
We did see "RAM price quadruple in no time so nobody had time to adapt", that's for sure.
But I'm really not sure it's "RAM prices goes 4x and then the world stays as it is and nobody adapts for decades to come".
Also as to used servers: people ordering years of compute hardware in advance aren't hoarding five years old servers.
Heck, a ten years old Xeon machine is plenty capable and the usual people are buying stocks of those (from companies updating their fleet), refurbishing them and reselling them one by one on the usual marketplace, at the same prices (OK maybe instead of 150 EUR it's now 200 EUR if there's 64 GB of ECC RAM).
My usual seller is doing its business as usual although we're well into the memory craze.
Just to put things into perspective: the "PC sales crash" from 2021 to 2024 saw, what, a 20% drop, 10% of which already recovered. In 4 years more than a billion PCs were produced.
A PC is not a rare thing. We won't run out of PCs, just like we won't run out of cheap used ten years old Xeon servers.
But OK you got me: I may contact my seller and hoard two or three more just in case.
Sheesh is HN full of paranoid people and, darn, is it contagious.
How do these prices compare to buying a PC in the early 90s?
How many 90s computer components went up in price a couple of years after release?
And I was told my whole life that capitalism solved everything through supply and demand magic.
I wish I could say I am disappointed.
What they conveniently leave out is that it sometimes takes over a decade for a correction
The market can stay irrational longer than you can stay solvent
The beauty of supply and demand magic is that the market is now open for anyone that can provide server hosting cheaply.
I can't wait for a scrappy startup to spend a couple billion dollars and several years setting up a new fab for chips so we can see the prices go down!
2 replies →
Good luck getting the hardware for that eh?
4 replies →
It is supply and demand but chip supply isn't very elastic and the producers are conservative about adding capacity that won't be needed by the time it's online.
SK Hynix just said they want to double wafer production by 2031.
5 replies →
Doesn’t this presume that chip fabs are betting that the AI boom is a bubble that’s going to pop?
Seems kinda hard to believe at this point, no?
2 replies →
Idealistically, actual consumer driven capitalism would be much closer to supply/ & demand than this (imo) almost completely artificial, government sponsored bubble. I think pricing before this current bubble reflects that.
Because, oddly enough, there are a lot more things going on. Government incentives, companies trying to stranglehold markets, FOMO-fueled massive investiment into the current fad, etc. Just to name a few.
[flagged]
I was also told this. Why isn't it happening? Can some capitalists explain why capitalism isn't happening the way it's supposed to? Is it because of government regulations, do we need to deregulate?
“Is it because of government regulations, do we need to deregulate?”
Insufficient law enforcement. The same memory manufacturers already broke antimonopoly laws in the past, pleaded guilty. Apparently the fines were too small for these companies to care, and the people responsible were promoted instead of being punished. More information: https://en.wikipedia.org/wiki/DRAM_price_fixing_scandal
Capitalism isn't a magical instant fix.
In this context, it takes spending enormous piles of money over the course of at least several years to spin up new semiconductor production.
We do need more capacity to keep up with AI datacenters' usage, yes.
But adding long-term capacity years down the road for a thing that some folks seem to confidently think is a bubble that can pop at any time is risky. And (because capitalism), we have to manage carefully balance our risks and rewards in order to maximize our odds of success.
If there is no bubble and demand stays high long-term, then the payoff for that risk is potentially enormous.
If there is a bubble and it bursts, then the cost of that risk is potentially devastating.
(Capitalism works most-predictably when cheating is possible, such as with Biff's use of the time machine in Back to the Future II. But without cheats, it's always a gamble.)
Sadly this is not a joke nor some doomsday thinking. Google recently repurposed thousands of phones for server needs. Why? Well guess why… to teach everyone tis coming.
To clarify: UC San Diego is planning to build a cluster of 2000 Pixel phones for computer science class use and Google, in support, helped with a test with 20 phones.
Goodness. Thank you for the clarification as this is leagues different than what I originally thought I was reading from the other comment.
> Google, in support, helped with a test with 20 phones.
Cheapest PR stunt ever.
Or they did it for positive PR.
To show they’re working on reducing the impact of data centres on the environment, and that they’re taking action on e-waste, all while saying their pixel phones are so powerful they can be clustered into servers.
And their announced test with 2000 phones, where one server is 25-50 phones, is only 40-80 servers. Interesting, but hardly hyper scale.