Comment by apitman 8 days ago Did you test multi-user cases? 1 comment apitman Reply jasonjmcghee 7 days ago Assuming this is equivalent to parallel sessions, I would hope so, this is like the entire point of vLLM
jasonjmcghee 7 days ago Assuming this is equivalent to parallel sessions, I would hope so, this is like the entire point of vLLM
Assuming this is equivalent to parallel sessions, I would hope so, this is like the entire point of vLLM