Comment by selectodude
3 days ago
> the capacity goes with it.
Sort of. The GPUs exist. Maybe LLM subs can’t pay for electricity plus $50,000 GPUs, but I bet after some people get wiped out, there’s a market there.
3 days ago
> the capacity goes with it.
Sort of. The GPUs exist. Maybe LLM subs can’t pay for electricity plus $50,000 GPUs, but I bet after some people get wiped out, there’s a market there.
Datacenter GPU's have a lifespan of 1-3 years depending on use. So yes they exist, but not for long, unless they go entirely unused. But then they also deprecate in efficiency compared to new hardware extremely fast as well, so their shelf life is severely limited either way.
Personally I am waiting for the day I can realistically buy a second hand three year old datacentre GPU so I can run Kimi K2 in my shed. Given enough time, not a pipe dream. But 10 years at least.
You'll probably be able to run Kimi K2 on the iphone 27.
This is why I find the business case of putting datacenters in orbit to be so stupid. And yet there are several startups saying they are gonna do just that.
At this pace, it won't be many years before the industry is dependent on resource wars in order to sustain itself.