Comment by esafak

Yes, serving requires infra, too. But you can use infra optimized for serving; nvidia GPUs are not the only game in town.