Comment by speedgoose

4 months ago

But you can run this model for free on a common battery powered laptop sitting on your laps without cooking your legs.

6 comments

speedgoose

Reply
hobofan  4 months ago

Sorry, but what are you talking about? This is a 120B-A6B model, which isn't runnable on any laptop except the most beefed up Macbooks, and then will certainly drain its battery and cook your legs.

  • naasking  4 months ago

    You can easily run a quant of this on a DGX Spark though. Seems like a small investment if it meaningful improves Lean productivity.

    • jasonjmcghee  4 months ago

      Is it though?

      Most people I know that use agents for building software and tried to switch to local development, every single time they switch back to Claude/codex.

      It's just not worth it. The models are that much better and continue to get released / improve.

      And it's much cheaper unless you're doing like 24/7 stuff.

      Even on the $200/m plan, that's cheaper than buying a $3k dgx or $5k m4 max with enough ram.

      Not to mention you can no longer use your laptop as a laptop as the power draw drains it - you'd need to host separately and connect

      2 replies →