Comment by numpad0

4 days ago

how can you say that with a username of "ngl999", that doesn't make sense

(IIUC, -ngl [NUM_LAYERS] specify number of layers to offload to GPU in llama.cpp, 999 on most use cases might as well be -1)