Comment by lxe

Interference optimization is a solved problem with no moat. Anybody can achieve this result, optimize for a particular hardware, optimize for a particular problem. In general, software is no longer a moat.

The moat is custom inference hardware, lower power, higher throughput, etc.