← Back to context Comment by mdp2021 5 months ago If you accept the "ggml-org":https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai...https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/mai... 1 comment mdp2021 Reply zkmon 5 months ago Do they run well on vLLM?
Do they run well on vLLM?