Comment by SillyUsername

8 hours ago

I just wish they'd support Pascal :(

Nvidia might have given up support but it doesn't mean vllm have to (llama.cpp didn't).

2 comments

SillyUsername

Reply

ta93754829 2 hours ago

Pascal? The programming language?

lightdot 1 hour ago

In this case, Pascal as a Nvidia's codename for a GPU microarchitecture.
https://en.wikipedia.org/wiki/Pascal_(microarchitecture)
I guess many would like to use stock vLLM to run inference on affordable P100...