Comment by OtherShrezzing
2 months ago
While that might be true, for as long as its name is “.cpp”, people are going to think it’s a C++ library and avoid it.
2 months ago
While that might be true, for as long as its name is “.cpp”, people are going to think it’s a C++ library and avoid it.
This is the first I'm learning that it isn't just a C++ library.
In fact the first line of the wikipedia article is:
> llama.cpp is an open source software library
It would make sense to just make the GUI a separate project, they could call it llama.gui.
It would make even more sense to rename it to ollama, get a copyright for the name, and see how thieves complain they've been robbed :>
it is called llama-barn https://github.com/ggml-org/LlamaBarn
LlamaBarn is the MacOS app, not the HTTP API server, which is "llama-server".
On non-Apple PCs, "llama-server" is what you use, and you can connect to it either with a browser or with an application compatible with the OpenAI API.
Perhaps using "llama-server" as the name of the project would have been less confusing for newbies than "llama.cpp".
I confess that when I first heard about "llama.cpp" I also thought that it is just a library and that I have to write my own program in order to implement a complete LLM inference backend.
this looks nice but is macos only.
This is correct, and I avoided it for this reason, did not have the bandwidth to get into any cpp rabbit hole so just used whatever seemed to abstract it away.
Wait, it isn't? The name very strongly suggests that it is a text file containing C++ source code; is that not the case?