Comment by xyzsparetimexyz
3 days ago
So you're arguing that ai companies overbought memory to increase scarcity? Possibly even buying e.g. consumer ddr?
3 days ago
So you're arguing that ai companies overbought memory to increase scarcity? Possibly even buying e.g. consumer ddr?
This has been suggested several times in the past by others: Data center builders bought up all RAM production for the foreseeable future to force anyone wanting any serious compute to become a customer of said data center builders. Unclear whether it's deliberate or just a convenient side-effect for said data center builders.
Hyperscalers and social media companies hired tech talent to keep folks from starting their own companies and keep other companies from hiring them.
memory companies are known to price fix as well, so i could really see either possibility tbh
and why not both?
just a theory! The end result was too make it difficult for me and you to run llms on our systems, and you need porwerfull system to run them. But some months ago, those powerfull systems where affordable for end consumers. Now, good luck buying let's say 128gb ddr5.
Do you believe this is more likely than corporations trying to restrict the supply for their corporate competitors? My thinking would be that we're just caught in the crossfire. The percentage of people seriously running their own models locally would hardly be any less diminishing if hardware prices were at their previous levels.
absolutely!