Comment by echelon

This unblocks future product work. You have to lay the groundwork.

We need advancements like this if we want on-device AI to work well. This is the kind of thing Apple Silicon needs especially. It's weak relative to Nvidia consumer chips.