Comment by desireco42
10 months ago
You can just use Ollama and have a bunch of models, some are good for planning, some are for executing tasks... this sounds more complex then it should be or maybe I am lazy and want everything neatly sorted.
I have models on external drive because Apple and through Ollama server they interact really well with Cline or Roo code or even Bolt, but I found Bolt really not working well.
To add, you can use so called, abliterated models that are stripped of censorship for example. Much better experience sometimes.