← Back to context Comment by soleveloper 4 hours ago They don't lead on latency nor quality; but their execution was superb 6 comments soleveloper Reply tietjens 4 hours ago Who they trailing on quality? baobabKoodaa 4 hours ago I'm not the person you're asking, but:https://benchmarkheaven.com/jev-modelsAccording to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups. tpetry 3 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 1 reply → deepsquirrelnet 4 hours ago Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind... nwhnwh 3 hours ago What even is this? What does it do?
tietjens 4 hours ago Who they trailing on quality? baobabKoodaa 4 hours ago I'm not the person you're asking, but:https://benchmarkheaven.com/jev-modelsAccording to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups. tpetry 3 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 1 reply → deepsquirrelnet 4 hours ago Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
baobabKoodaa 4 hours ago I'm not the person you're asking, but:https://benchmarkheaven.com/jev-modelsAccording to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups. tpetry 3 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 1 reply →
tpetry 3 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 1 reply →
deepsquirrelnet 4 hours ago Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
Who they trailing on quality?
I'm not the person you're asking, but:
https://benchmarkheaven.com/jev-models
According to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups.
And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points.
1 reply →
Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
What even is this? What does it do?