Comment by mediaman

I think you would be less annoyed if you worked with these systems and used them in production.

Jev's pricing is 4.2 cents per million input tokens, less than half of Gemma 4. Qwen, gemma etc all have terrible non-uniform probabilities; in my testing, Jev's probability scores perform much, much better.

I'm usually seeing round trip classifications from Jev at <200ms for a completed query even with 10k+ input tokens. Gemma 4, depending on the provider, is about 200 ms time to first token - not time to completion. You can likely get better response running it locally, but then you're arguing why you're renting a low utilization 5090 when you could be paying $42 per billion tokens.

Jev can also run dozens of dimensions of classification in one call, without autoregressively generating a sequence of tokens. (i.e., it is much faster and has less order dependency.)

I've been running jev in some specific use cases and see much better speed and better accuracy than just using structured output from gemma/qwen.

I don't understand how the "just use gemma" crowd has this belief if they've actually built and tested the systems against each other.