They are? In all my evals at work, Jev seems to win, despite me wanting the open weight versions to.
I imagine if I fine tuned one of the open weight models for my use case it would be possible to beat it, though, but as a general drop in decision model, I’ve not really seen much that beats it especially for the cost
Same here, and I have a project 100% hosted in Cloudflare ecosystem (AI Gateway, Workers, Queues, R2, D1, DO, etc) I was so happy when I saw clef. Tested, and it's bad. Slower and wronger than Jev.
Still waiting on Decisions API using Luna, as this what I was using before.
They are? In all my evals at work, Jev seems to win, despite me wanting the open weight versions to.
I imagine if I fine tuned one of the open weight models for my use case it would be possible to beat it, though, but as a general drop in decision model, I’ve not really seen much that beats it especially for the cost
Same here, and I have a project 100% hosted in Cloudflare ecosystem (AI Gateway, Workers, Queues, R2, D1, DO, etc) I was so happy when I saw clef. Tested, and it's bad. Slower and wronger than Jev.
Still waiting on Decisions API using Luna, as this what I was using before.
Run your own evals, folks.
We evaluated the Decisions API at work and it was worse in all dimensions (price, speed, and quality of the result).
Or they use it as marketing wording to get liked by devs.., which is most likely given we know that’s typesafes usp
we've been public about this before the category was even created