Comment by TomGarden
3 days ago
Yeah I'm more excited about the prospect of them explicitly saying it, which hopefully can lead to better places down the line.
I thought DS Flash needed 2bit quant to work on 128GB? I have an m4 max 128 GB and the most reasonable model to run still seems to be qwen's 32B A3B
No comments yet
Contribute on Hacker News ↗