Comment by Cyph0n

Not that straightforward. Similar to CPUs and other HW, there are errata and interop quirks between devices.

There are also tight time budgets (basically SLAs) that must be met along with memory considerations (both in SW and on the NPU/HBM), not to mention how the device needs to respond to load and various failure scenarios.