Often the math works out that you get a lot more for $20 a month if you settle for smaller sized but capable models (8b-30b). I don’t see how it’s better other than Ollama can “promise” they don’t store your data where as OpenRouter is dependent on which host you choose (and there’s no indicator on OpenRouter exposing which ones do or don’t).
In a universe where everything you say can be taken out of context, things like OpenAi will be a data leak nightmare.
Often the math works out that you get a lot more for $20 a month if you settle for smaller sized but capable models (8b-30b). I don’t see how it’s better other than Ollama can “promise” they don’t store your data where as OpenRouter is dependent on which host you choose (and there’s no indicator on OpenRouter exposing which ones do or don’t).
In a universe where everything you say can be taken out of context, things like OpenAi will be a data leak nightmare.
Need this soon:
https://arxiv.org/abs/2410.02486