Comment by bavell
8 months ago
Sucks that you've had so much trouble... My experience with my cheap 6750XT is that it just works OOTB on Arch with rocm, llama.cpp, ollama, whisper, etc by setting an envvar.
8 months ago
Sucks that you've had so much trouble... My experience with my cheap 6750XT is that it just works OOTB on Arch with rocm, llama.cpp, ollama, whisper, etc by setting an envvar.
Did you do any writeup/post on your experience with setting it up? I think it would have some audience ( apart from me that is ).
It never occurred to me because it was such an easy process kn Arch.
https://wiki.archlinux.org/title/Ollama 3 commands to install and run an LLM.
Hmm. Thank you. I clearly was doing something wrong ( non arch distro though ). Will try again today:D
This has been my experience with a 6950XT as well using Fedora.