Comment by rahimnathwani

  brew install llama.cpp
  llama-server -hf unsloth/gemma-4-12b-it-GGUF:UD-Q8_K_XL