Comment by charcircuit
15 hours ago
>That prices would rise
Competition will prevent that from happening. When anyone can host open models and there is giant demand for LLMs companies can not easily raise token prices without sending a lot of traffic to their competitors.
> When anyone can host open models
They'd still need to pay the actual power costs.
I didn't say that inference would be free, but that everything to do inference is a commodity which means that competition is easy to do.