Comment by andsoitis

Inference is projected to continue to become increasingly commoditized so you need to wrap it in compelling and differentiated product people are willing to pay for.

Training, people argue, continue to be very capital intensive so moat there. What I'm wondering, is anyone trying out ideas the lower the training cost materially? I'm not thinking distilling because that, by definition, would always be behind the frontier. Other ways?