← Back to context

Comment by quantumink

18 hours ago

The case of your 5090 having become a coveted artifact of great rarity in these times - may be a nuance of some measure.

Also, the following two have very different 'needs' to feel good enough:

1. heavy agentic workloads via harness vs 2. a simple private chat interface with a local instance

Even if an MBP's bandwidth were higher, it's tough to see a reason to run it as a constantly loaded 24/7 inference machine due to heat degradation.

P.S. still extremely awesome to be able to host and chat with a decently quantized 27B model on your laptop. ...and to be fair even a 32GB Air would do that! It is a thing of beauty: the amount of folks this may add to the hacker/tinker community.