Comment by lousken
12 hours ago
It is embarrassing how much they suck up to american labs while those models only perform the first few days after release. With open weights you can be sure the quality stays the same unlike the closed source crap. How about a retest after some time?
> With open weights you can be sure the quality stays the same
Or improves. With third-party fine-tuning.
Performance depends so much on configuration parameters like KV cache that you have essentially no idea what you're getting unless you run and benchmark everything yourself, which I'm sure you do not do. If anything, hosters of open weight models are more likely to gimp it either due to incompetence or malice because they have no reputation to lose.
Reputable hosting providers, e.g. Fireworks, Cloudflare, Baseten, whatever absolutely _do_ have a reputation to lose.