Comment by miki123211

Alternatively, modern AI is good enough at optimizing its own kernels that it just keeps pushing costs down. Unlike the semi-decentralized inference provider community, OpenAI has both the talent and the compute to throw at the problem of making their models much more efficient to run.

GPU kernel optimization is just the kind of well-bounded problem with clear success criteria that AI loves.