Comment by danielEM

20 hours ago

Is there a way to run it on Vulkan?

No. Sadly, NVIDIA killed any kind of compute via Vulkan.

I took few minutes to try to make it work on ROCm (AMD's alternative to CUDA), landed in python dependency hell.

  • > NVIDIA killed any kind of compute via Vulkan

    What do you mean? They are the ones introducing the matmul extensions to Vulkan, which makes compute like this possible