Comment by soleveloper 6 hours ago They don't lead on latency nor quality; but their execution was superb 7 comments soleveloper Reply tietjens 6 hours ago Who they trailing on quality? baobabKoodaa 6 hours ago I'm not the person you're asking, but:https://benchmarkheaven.com/jev-modelsAccording to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups. tpetry 5 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 2 replies → deepsquirrelnet 6 hours ago Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind... nwhnwh 5 hours ago What even is this? What does it do?
tietjens 6 hours ago Who they trailing on quality? baobabKoodaa 6 hours ago I'm not the person you're asking, but:https://benchmarkheaven.com/jev-modelsAccording to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups. tpetry 5 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 2 replies → deepsquirrelnet 6 hours ago Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
baobabKoodaa 6 hours ago I'm not the person you're asking, but:https://benchmarkheaven.com/jev-modelsAccording to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups. tpetry 5 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 2 replies →
tpetry 5 hours ago And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points. 2 replies →
deepsquirrelnet 6 hours ago Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
Who they trailing on quality?
I'm not the person you're asking, but:
https://benchmarkheaven.com/jev-models
According to this benchmark, Jev is currently trailing Quyet-1.0-Large and a few other hastily put-together LLM-based decision API-like setups.
And the 'better' ones are slower and cost more for a tiny bit more accuracy. Its hard to sell that as being better when speed and price have been JEVs main selling points.
2 replies →
Here's another leaderboard: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
What even is this? What does it do?