Comment by quantumink
16 hours ago
The case of your 5090 having become a coveted artifact of great rarity in these times - may be a nuance of some measure.
Also, the following two have very different 'needs' to feel good enough:
1. heavy agentic workloads via harness vs 2. a simple private chat interface with a local instance
Even if an MBP's bandwidth were higher, it's tough to see a reason to run it as a constantly loaded 24/7 inference machine due to heat degradation.
P.S. still extremely awesome to be able to host and chat with a decently quantized 27B model on your laptop. ...and to be fair even a 32GB Air would do that! It is a thing of beauty: the amount of folks this may add to the hacker/tinker community.
No comments yet
Contribute on Hacker News ↗