← Back to context

Comment by bdhcuidbebe

6 months ago

> I'm willing to bet that Vulkan will outperform OpenVINO.

> Vulkan is the API right now in the graphics world.

YUP, Vulkan is all the rage in the graphics world, and for good reasons. But we arent discussing graphics now are we?

Vulkan is a general graphics API with some computing capabilities.

OpenVINO is a toolkit for inference neural networks, by intel built to make use of their GPUs and NPUs for this specific task.

Using vulkan, first you need to translate your payload to shaders, then they need to be compiled to SPIR-V, then they can use a subset of the cards capabilities.

How could this even remotely match something written specifically for the task?

Also, it is dead easy to benchmark if you still think otherwise.

Or just read up on it..

OpenVINO is quasi-abandoned, nobody uses it, Intel barely puts any effort to improve it.

Vulkan is used by millions and huge money goes into optimizing it.

My money is on Vulkan.