Comment by buyucu
6 months ago
I'm willing to bet that Vulkan will outperform OpenVINO.
Vulkan is the API right now in the graphics world. It's very well supported and actively being improved on. Everyone is pouring resources into making Vulkan better.
OpenVINO feels barely developed. Intel never made it a proper backend for Pytorch like AMD did with ROCm. It's hard to see where it is going, or if it is going anywhere at all. Between Sycl and OneApi it's hard to see how much interest Intel has developing it.
> I'm willing to bet that Vulkan will outperform OpenVINO.
> Vulkan is the API right now in the graphics world.
YUP, Vulkan is all the rage in the graphics world, and for good reasons. But we arent discussing graphics now are we?
Vulkan is a general graphics API with some computing capabilities.
OpenVINO is a toolkit for inference neural networks, by intel built to make use of their GPUs and NPUs for this specific task.
Using vulkan, first you need to translate your payload to shaders, then they need to be compiled to SPIR-V, then they can use a subset of the cards capabilities.
How could this even remotely match something written specifically for the task?
Also, it is dead easy to benchmark if you still think otherwise.
Or just read up on it..
OpenVINO is quasi-abandoned, nobody uses it, Intel barely puts any effort to improve it.
Vulkan is used by millions and huge money goes into optimizing it.
My money is on Vulkan.