Comment by lelanthran

> yes, but at that point even open weight models are not free. Can someone set up the best open-weight model for free and charge pretty much just for GPU usage+operations+margin for inference? yes.

Or, the company itself can rent the GPU and host the model of their choice on it.

> But they would have to keep up with how good the private models are.

Why? The whole point of the thread is that the marginal gains of using private models is a fraction of the additional cost of using those private models.

IOW, if you really need that improvement over the open models, you can go ahead and pay it. What we are seeing though is that the improvement in general is barely noticeable but the cost is 4x as much.