Comment by Animats

Whether inference hardware will be a commodity remains to be seen. We had twenty years of most servers being x86-64. That's commodity compute. Inference hardware isn't a mature architecture yet. There will be progress and obsolescence.