Comment by tarsinge
3 months ago
I don’t know if Google will win but the message they sent is that Nvidia will not: if Google can release the best model without using their own chips instead of GPUs, and save money in the process, then others (Microsoft, Amazon, etc.) will do it too sooner or later.
That is the opposite of good. If only big companies can afford bespoke hardware, they literally become a monopoly, At home LLMs and other usages become either prohibitively expensive in purchase and running cost or you have to deal with a low quality model. Just admit that it's environmentally fucked and not open in any sense. This is not something that the community at large should strive for.