Comment by amelius
1 day ago
> > NVIDIA is one of the most open labs.
> Of course they are. They're commoditizing their complement
Then why don't they sell consumer GPUs with tons of memory. They clearly segment the market into consumer versus server/business.
There are - see the RTX Pro 6000, which has 96 GB.
There are a few problems though, primarily, a GPU with lots of VRAM and very high bandwidth is inherently very expensive (on top of which there is also the CUDA premium); AI use cases are better served by SoCs with lower (but still high) bandwidth and more RAM.
The upcoming RTX Spark [0] is aiming to fill that space -- consumer GPUs with tons of memory.
[0] - https://www.nvidia.com/en-us/products/rtx-spark/
This is not a GPU, this is a laptop SoC with CPU and integrated GPU, and knowing nvidia it will probably be even more closed than an intel CPU. You will own even less of your hardware
Nearly all ARM CPUs are "even more closed than an intel CPU" on a driver level. Nvidia stands out by supporting UEFI on ARM, which even Apple refuses: https://docs.nvidia.com/dgx/dgx-spark/uefi-settings.html