Comment by benxh
1 year ago
My biggest gripe with Ollama is the badly named models, e.g. under deepseek-r1, it defaults to the distill models.
1 year ago
My biggest gripe with Ollama is the badly named models, e.g. under deepseek-r1, it defaults to the distill models.
I agree they should rename them.
But defaulting to a 671b model is also evil.
No. If you can't run it and most people can never run the model on their laptop, it's fine, let people know the fact, instead of giving them illusion.
Letting people download 400GB just to find that out is also .. not optimal.
But yes, I have been "yelled" at on reddit for telling people you need vram in the hundreds of GB.
1 reply →
at least the distilled models are officially provided by deepseek (?)