Comment by tsss

Performance depends so much on configuration parameters like KV cache that you have essentially no idea what you're getting unless you run and benchmark everything yourself, which I'm sure you do not do. If anything, hosters of open weight models are more likely to gimp it either due to incompetence or malice because they have no reputation to lose.