Comment by ekianjo
4 days ago
completely useless move. there are already tons of good clients for Ollama. The Ollama devs need to focus on being a better llama.cpp, not building clients.
4 days ago
completely useless move. there are already tons of good clients for Ollama. The Ollama devs need to focus on being a better llama.cpp, not building clients.
Ollama is a VC funded company that ultimately needs a revenue model they serve investors, not open source developers. Llama.cpp is a means to an end to them, not the goal. It's hard to monetize open source libraries. But a good chat client might lead to paying enterprise users.
Running good enough models locally is appealing to a lot of people and kind of hard if you are not a developer. If you are it's easy (been there done that). That's the core premise of the company. Their tech is of course widely used and for a while they've been focusing just on getting it to that stage. But that's never going to add up to revenue. So, they need to productize what they have.
This looks like a potentially viable way.