Comment by ontouchstart
13 days ago
I use a nix one-liner to run llama.cpp on M5.
``` nix run nixpkgs#llama-cpp -- server --models-dir models -m models/gemma-4-12B-it-Q8_0.gguf --port 8080 ```
open http://localhost:8080.
I also run pi in a docker container to do some vibe agentic coding. But I prefer `cat flake.nix | pbcopy` and paste into the browser. Then I can export the jsonl files and use tools to convert them to md and push to GitHub Pages.
I can do most of AI sessions off-line and only need hotspot to sync with GitHub.
My main use case is to learn and hack nix on Mac. It is fun.
No comments yet
Contribute on Hacker News ↗