← Back to context

Comment by yjftsjthsd-h

1 year ago

> If ollama's free hosted models were no longer free and you had to manually find and download your own model files, would you still use it? Could you still use it?

I would absolutely still use it; I've already ended up feeding it gguf files that weren't in their curated options. The process (starting from having foo.gguf) is literally just:

    echo FROM ./foo.gguf > ./foo.gguf.Modelfile
    ollama create foo -f foo.gguf.Modelfile

(Do I wish there was an option like `ollama create --from-gguf` to skip the Modelfile? Oh yes. Do I kinda get why it exists? Also yes (it lets you bake in a prompt and IIRC other settings). Do I really care? Nope, it's low on the list of modestly annoying bits of friction in the world.)