Comment by julianlam

16GB VRAM could load a small quantised qwen 27B model but it would be a ways away from a frontier cloud model.

Though keep in mind not being beholden to shenanigans from said cloud companies (and interference from government entities!) is definitely worth something intangible.