Comment by fouc

just so you know, you can grab any gguf from huggingface and specify the quant like this:

  ollama pull hf.co/bartowski/nvidia_OpenCodeReasoning-Nemotron-7B-GGUF:IQ4_XS