Comment by DiabloD3

2 hours ago

Surprised its not meaningfully slower.

Vulkan and ROCm paths are missing a few optimized versions of the quants they're using.