Comment by timmg
7 days ago
It says “usage-based pricing” is coming soon. I think that is the sweet spot for a service like this.
I pay $20 to Anthropic, so I don’t think I’d get enough use out of this for the $20 fee. But being able to spin up any of these models and use as needed (and compare) seems extremely useful to me.
I hope this works out well for the team.
> It says “usage-based pricing” is coming soon. I think that is the sweet spot for a service like this.
Agreed, though there are already several providers of these new OpenAI models available, so I'm not sure what ollama's value add is there (there are plenty of good chat/code/etc interfaces available if you are bringing your own API keys).
A flat fee service for open-source LLMs is somewhat unique, even if I don't see myself paying for it.
Usage-based pricing would put them in competition with established services like deepinfra.com, novita.ai, and ultimately openrouter.ai. They would go in with more name-recognition, but the established competition is already very competitive on pricing
I mean $20/month for API access is definitely new.