Comment by verdverm

hey Claude, download and run vllm nightly for me

(already merged)

GoModel (gateway) already supports Jev like endpoints too

https://gomodel.enterpilot.io/docs/providers/jev