Comment by marcelo-earth

And almost all consumer software has AI now.

> But what if you want to add AI to your product? Well, now you have some real inference costs on every request!

Eventually, these companies just lower their costs by using more efficient models. There were consumer companies built on GPT-3.