Comment by mohsen1

20 hours ago

There is an open PR for VLLM to do this via DefussionGemma

https://github.com/vllm-project/vllm/pull/57250

0 comments

mohsen1

Reply

No comments yet

Contribute on Hacker News ↗