Comment by hodgehog11

6 months ago

I think this is the thing: if you can use llama.cpp, you probably shouldn't use Ollama. It's designed for the beginner.

4 comments

hodgehog11

Reply
otabdeveloper4  6 months ago

You shouldn't use Ollama as a beginner either. It comes with crazy begginer-hostile defaults out of the box.

  • A4ET8a8uTh0_v2  6 months ago

    Hmm? I would argue against that line of argumentation. It is ridiculously easy to start out of box and working. Once the user starts moving against obvious restrictions resulting from the trade-offs in defaults, they can move on to something more custom. Woulnd't that be the definition of beginner friendly?

    I am biased since I effectively started with Ollama as my main local llm so take this response for what it is.

    Still, you got me curious. Which defaults you consider hostile ( not disagreeing; this is pure curiosity )?