Comment by alchemist1e9

4 months ago

Are the design specifications, like interconnect, GPUs, CPUs, memory and storage of this new cluster public? I seem to recall xAI has made public theirs. I’m mostly asking out of curiosity and a desire to read up on the SOTA hardware specs being used. EDIT: this has some interesting details — https://www.adwaitx.com/meta-prometheus-ai-cluster/

I assume eventually all this investment should result in price drops for cloud GPU rates. Maybe somebody has setup an automated rate aggregator and collected the data? It would be interesting to see the historical data and monitor the changes, like dollars per TFLOP/hr or something standardized to track over time like other economic data or prices. EDIT: this is along the lines and pretty interesting — https://www.unitedcompute.ai/gpu-price-tracker

I know I’m mixing two different thoughts but they are connected in my head for entrepreneurs interested in starting independent tech/AI/LLM businesses needing heavy compute infrastructure.

It’s complicated.

Old GPUs (ex hopper, A100) prices has been dropping but the new ones will go up.. so yes it doesn’t need to crash for you to have cheaper gpus