Comment by tehsauce

10 hours ago

“888 KiB Assistant” but the assistant itself is a multi terabyte rental-only model stored in some mysterious data center.

9 comments

tehsauce

Reply
seertaak  3 hours ago

The whole point is that this fits on an ESP32, which has wifi. We're not quite at the point where it makes sense to run the whole thing locally - if you do try it, it will need a fan, and be loud etc.

For my part, I installed Nanoclaw on my Arch derived OS (I love Arch!), and it worked fine until the next day some update decided to revert the power management settings, and now my glorious assistant is dead.

There's something to be said for a barebones OS. No bullshit, no updates.

Also, playing with hardware watchdog timers and GPIOs and DACs can be so much fun.

Rebelgecko  8 hours ago

It seems to support connecting to your own LLM on the same LAN

  • dheera  7 hours ago

    I tried connecting OpenClaw to ollama with a V100 running qwen3.5:35b but it was really, really, really slow (despite ollama itself feeling fairly fast).

    These "claw" agents really multiply the tokens used by an obscenely huge factor for the same request.

    • jcgrillo  4 hours ago

      i recently decided to get into this ocean boiling game too, the 32GB V100 seems like a pretty good VRAM/$. if i may ask, do you make any special accommodations for cooling? i've never dealt with a passively cooled card before and i'm curious whether my workstation fans (HP Z840) will be sufficient. i'm going to try 2 cards at first but i think i might be able to squeeze a third in there

      2 replies →