Comment by sergiotapia
5 months ago
Be careful with openrouter. They routinely host quantized versions of models via their listed providers and the models just suck because of that. Use the original providers only.
5 months ago
Be careful with openrouter. They routinely host quantized versions of models via their listed providers and the models just suck because of that. Use the original providers only.
I specifically do not use the CN/SG based original provider simply because I don't want my personal data traveling across the pacific. I try to only stay on US providers. Openrouter shows you what the quantization of each provider is, so you can choose a domestic one that's FP8 if you want
Funny, living in Europe, I prefer using EU and Chinese hosts because as I don't want my data going to the US.
The trust in US firms and state is completely gone.
Living in the US, my trust in US firms and state is also completely gone. My only hope is local LLMs.
Tangent note: this sounds like the same mistake as EU's reliance on Russia.
3 replies →