Comment by ux266478

14 hours ago

They should probably look at moving away from general purpose hardware for their actual products, and reserve GP hardware for RnD. You don't need frontier nodes to run circles around GPGPUs, an ASIC made with 28nm is more than enough to embarrass an H100 (and much cheaper)

AI is in such desperate need to adopt software-hardware co-development practices, it's infuriating watching the industry drag its feet about it. We are wasting so much electricity and absolutely wrecking the "free" market just because these companies are incentivized to work at an unsustainable breakneck speed in getting shit to market.