Comment by verdverm

afaict, they have their own package repo mirrors and a few dedicated packages for nvidia stuff

tbh, I was rather unimpressed with the out-of-box experience for an "ai" computer, you couldn't even run a model locally with the common tools people use (no llama-cpp, ollama, vllm, etc). No huggingface CLI eiher, like come on!

I did put together my eventual setup in a repo https://github.com/verdverm/sparky

I need to update that because I have a nice vllm setup on there now with 4 models running, but should be able to get anyone else going without having to muddle about as I did.