Comment by 999900000999
6 hours ago
Wait ?
You don't trust Nvidia because the drivers are closed source ?
I think Nvidia's pledged to work on the open source drivers to bring them closer to the proprietary ones.
I'm hopping Intel can catch up , at 32GB of VRAM for around 1000$ it's very accessible
Nvidia has been pledging that for years. If it ever actually happens, I am here for it.
It happened 2 years ago:
https://developer.nvidia.com/blog/nvidia-transitions-fully-t...
Their userspace is still closed. ROCm is fully open.
> Intel
For some workloads, the Arc Pro B70 actually does reasonably well when cached.
With some reasonable bring-up, it also seems to be more usable versus the 32gb R9700.
I have both of those cards. Llama.cpp with SYCL has thus far refused to work for me, and Vulkan is pretty slow. Hoping that some fixes come down the pipe for SYCL, because I have plenty of power for local models (on paper).