Comment by pianopatrick
21 hours ago
Maybe open AI and Anthropic could just license their models to run on your own hardware. So a fixed cost instead of per token pricing or subscription with limits
21 hours ago
Maybe open AI and Anthropic could just license their models to run on your own hardware. So a fixed cost instead of per token pricing or subscription with limits
Fixed costs are already available via PTU reservation and afaik most serious enterprise projects are using this
This would require them to give you a copy of their models, which would quickly be leaked on the internet, and they know that, so it won't happen.
Google is already doing that since last year and the models where never leaked, so I don't think that would even be a problem.
https://cloud.google.com/blog/topics/hybrid-cloud/gemini-is-...
This is the future, because the market will demand it.
I think there will be separate and huge markets for models, hardware and compute. That will maximize competition and innovation.
Why? Because even Blind Freddy can see the huge usefulness and power of these (and future non-LLM) models and no-one in their right mind is interested in becoming OpenAI's or Anthropic's bitch. Those companies have tickets on themselves.
Given the recent behavior of tech companies and the US administration, no one trusts either anymore.
But think about the safety!! (/s)