Comment by KaiserPro

> it's not AI that requires massive resources

no it really is. If you took away training costs, OpenAI would be profitable.

When I was at meta they were putting in something like 300k GPUs in a massive shared memory cluster just for training. I think they are planning to triple that, if not more.