Comment by ece

I disagree with the first half quite a bit, COGS ultimately depends on the use case. If someone just wants something that a smaller model can do, running a local model on phone is going to have a negligible cost close to running any other piece of software. The alternatives to running a model also determines COGS, and even Jensen Huang has distinguished between the job and the work for the job that AI is capable of doing. Smaller models are always going to win in efficiency too.

I also heavily disagree with this no-marginal cost in software distribution view whenever I see it, bit rot is real, and someone is paying a marginal cost whenever they do an update. You have to re-distribute with changes whenever anything changes. These costs are just hidden because things are ad-supported or bundled in some way. These costs are also kept low because of standards and open source, but could become high anytime. Additional licensing also has costs.

That said, I couldn't agree more with the last paragraph, charging a high price for models would be better than denying access for any model that wants to stay relevant.