← Back to context

Comment by xphos

2 days ago

Remember the part of the article where he talks about a shocking number of people didnt have the version of AVX he wanted. This is a big issue because SIMD is writing ASM for the most part not C code so new architecture you have problems . RVV riscv SIMD has an interesting way to adapt to different CPU tiering and is a rather complete SIMD architecture but most SIMD architectures have small holes which can be mildly annoying

Simd is by far the most efficient cycles wise paradigm but its also brittle. When the shape of data is odd which is common enough you have to handle it properly which is sometimes a distraction from what people actually care about. Also GPUs exist, GPUs despite being way less power efficient are not brittle in this same way they have issues if memory is difficult but most problems work nicely on GPUs so people just do that because its easier and the tiering problem is less a big deal because GPU process instructions different than SIMD and batching and what not is left to hardware not the programmer