Comment by SillyUsername
7 hours ago
I just wish they'd support Pascal :(
Nvidia might have given up support but it doesn't mean vllm have to (llama.cpp didn't).
7 hours ago
I just wish they'd support Pascal :(
Nvidia might have given up support but it doesn't mean vllm have to (llama.cpp didn't).
Pascal? The programming language?
In this case, Pascal as a Nvidia's codename for a GPU microarchitecture.
https://en.wikipedia.org/wiki/Pascal_(microarchitecture)
I guess many would like to use stock vLLM to run inference on affordable P100...