Spot prices for 5 year old A100s are still going up recently, because inference is so valuable. This meme that GPUs are a quickly depreciating asset is outdated.
Their lifespans are 2 to 4 years with always on, heavy usage. Even then the problem isn’t the lifespan. It’s the lack of supply right now. I assume with more built out production capacity GPUs get cheaper too. The whole vertical stack needs to get cheaper and it will in time.
Spot prices for 5 year old A100s are still going up recently, because inference is so valuable. This meme that GPUs are a quickly depreciating asset is outdated.
Their lifespans are 2 to 4 years with always on, heavy usage. Even then the problem isn’t the lifespan. It’s the lack of supply right now. I assume with more built out production capacity GPUs get cheaper too. The whole vertical stack needs to get cheaper and it will in time.