Comment by verdverm

With all the excitement around Jev, I suspect we'll see hundreds of options, it doesn't sound like Jev is that hard to replicate, given all the 3rd parties who are getting pretty damn close, or even better, results within a week.

vLLM has a PR very close to merging: https://github.com/vllm-project/vllm/pull/57250

Kev is an open Jev: https://github.com/jaredpalmer/kev