Comment by MattRix
3 hours ago
It has nothing to do with his POV or even ego. It was an objectively true fact. GPUs in data centers do get more utilization than those used locally. That's all he was saying.
3 hours ago
It has nothing to do with his POV or even ego. It was an objectively true fact. GPUs in data centers do get more utilization than those used locally. That's all he was saying.
Something can be a true fact and still be an ill-advised or tone deaf thing to say.
Especially when you take into account that people are largely unconcerned about true facts, and will gladly misquote or misinterpret you just in order to be outraged.
Is it really "all he was saying" when he's single handedly responsible for creating a worldwide RAM and NAND shortage?
He said/implied that we would have shortage either way (without data center buildout, but everyone who wants access to LLM does private/local inference), which doesn't sound far fetched.
Single handedly? I'd say the the people using (or forcing others to use) the models, therefore justifying the need for them, play a part in it.