Comment by primitivesuave
2 years ago
A government computing project acquiring 10k GPUs is pretty impressive, but can hardly be deemed a "competitive advantage" - Google and AWS are already offering double the computing power in a single data center [1]. OpenAI is likely already using a cluster of at least this size to train ChatGPT.
1. https://www.hpcwire.com/2023/07/27/aws-cramming-up-to-20000-...
It's the right order of magnitude. Things will happen, given the will, the acquired hardware, and the brains in EPFL and ETH Zurich.