Comment by apatheticonion
13 hours ago
Right!? Linux can be configured to idle at less than 500mb of ram - by contrast, with some aggressive shenanigans, MacOS can idle at 2-3gb.
When running inference, I would love to use all of my hardware please Apple.
It idles at 2-3GB but when your apps need the RAM, does it free up system memory so that it's closer to 500MB?
I use my Mac as a headless server to run LLMs, and never even start a desktop session so it always stays at pre-login state without any applications running. Even so, I never saw it using less than 2G in htop when logged via SSH.