I searched for any link between OmniAI and Alibaba's Qwen, but I can't find any link. Do you know anything I don't know?
All of these models are open source (I think?). They could presumably build their work on any of these options. It behooves them to pick well. And establish some authority along the way.
Generally running the whole benchmark is ~$200, since all the providers cost money. But if anyone wants to specifically benchmark Omni just drop us a note and we'll make the credits available.
I searched for any link between OmniAI and Alibaba's Qwen, but I can't find any link. Do you know anything I don't know?
All of these models are open source (I think?). They could presumably build their work on any of these options. It behooves them to pick well. And establish some authority along the way.
The model with the best accuracy in the linked benchmark is "OmniAI" (OP's company) which looks like a paid model, not open source [1].
[1]: https://getomni.ai/pricing
Someone should try to reproduce and post it here. I can't, my PC is about 15 years old. :(
(It is not a joke.)
Reproducing the whole benchmark would be expensive, OmniAi starts at $250/month.
Generally running the whole benchmark is ~$200, since all the providers cost money. But if anyone wants to specifically benchmark Omni just drop us a note and we'll make the credits available.
So not all of them are local and open source? Ugh.
4 replies →
To be fair, they didn't include themselves at all in the graph.
They did. It’s in the #1 spot
Update: looks like the removed themselves from the graph since I saw it earlier today!
Yup, they did.
The beauty of version control: https://github.com/getomni-ai/benchmark/commit/0544e2a439423...