Comment by YetAnotherNick
2 years ago
Can quality score be added for each inference provider for the same model. Many of them use different quantization and approximation so that it's not just price and throughput that's important. Specially for model like Mixtral.
No comments yet
Contribute on Hacker News ↗