Comment by kllrnohj
1 hour ago
Doesn't it come with Nvidia's blend of Ubuntu with a custom kernel? Do other distros work as well as "DGX OS" or are nvidia's kernel changes pretty important to have?
1 hour ago
Doesn't it come with Nvidia's blend of Ubuntu with a custom kernel? Do other distros work as well as "DGX OS" or are nvidia's kernel changes pretty important to have?
Hopefully better than support on their Jetson or orin boards, where compiling anything is hard because of the outdated stack.
I've not noticed much in it that is NVIDIA specific.
But I would say that as an Ubuntu and Debian user for decades I have no incentive to use anything else on it and I'm just pleased to have a Linux on Aarch64 machine that is well supported for a change.
For some value of "well supported" - NVIDIA's own internal catalogs (libraries, NIMs, etc) are still spotty on aarch64 coverage.
afaict, they have their own package repo mirrors and a few dedicated packages for nvidia stuff
tbh, I was rather unimpressed with the out-of-box experience for an "ai" computer, you couldn't even run a model locally with the common tools people use (no llama-cpp, ollama, vllm, etc). No huggingface CLI eiher, like come on!
I did put together my eventual setup in a repo https://github.com/verdverm/sparky
I need to update that because I have a nice vllm setup on there now with 4 models running, but should be able to get anyone else going without having to muddle about as I did.