Comment by CuriouslyC
13 hours ago
Be careful about unofficial providers, a lot of them misconfigure models or stealth quantize them. For a while the difference between Kimi on the official API and most third party providers was 20-40%.
13 hours ago
Be careful about unofficial providers, a lot of them misconfigure models or stealth quantize them. For a while the difference between Kimi on the official API and most third party providers was 20-40%.
Kimi K2 had a vendor verifier: https://github.com/MoonshotAI/K2-Vendor-Verifier
(there's a table which shows comparison between vendors)
Also, it seems there's a general one as well (for all kimi models?): https://github.com/MoonshotAI/Kimi-Vendor-Verifier
OpenRouter should be penalising or banning for this.
This is my biggest complaint about OpenRouter and I'm a fan. Might be pretty tough at scale?
They have an "exacto" category with providers they supposedly verified
That’s only for tool use.
Would that align with their VC-backed incentives?
If your users can't trust your product then I'd say that'd be a pretty strong incentive?
the 2 I mentioned both have a fairly large following, who run benchmarks and absolutely will spot issues.