Comment by hugmynutus
6 days ago
> Commodity hardware and software will continue to drop in price.
The software is free (citation: Cuda, nvcc, llvm, olama/llama cpp, linux, etc)
The hardware is *not* getting cheaper (unless we're talking a 5+ year time) as most manufacturers are signaling the current shortages will continue ~24 months.
> The software is free (citation: Cuda, nvcc, llvm, olama/llama cpp, linux, etc)
If you factor in the cost of integration and ongoing maintenance - by humans or llms - it is not free. But it certainly has never been cheaper.
> The hardware is not getting cheaper (unless we're talking a 5+ year time)
Yes, that's the time I'm talking about.
You also had a blip with increasing hard disk prices when Thailand flooded a few years ago.
GB300 NVL72 is 50% more expensive than GB200 I've heard.