Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library
← Back to context

Comment by jacquesm

20 hours ago

That rig is running single GPU most of the time and like that it is good for 95% of what I'm doing. If I need to evaluate a large model or if the smaller ones get stuck on a problem (which does happen) then I run GLM 5.3 3.86 bpw on all of the GPUs. It's a nice space heater in that configuration, so I see it as co-generation ;)

0 comments

jacquesm

Reply

No comments yet

Contribute on Hacker News ↗

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities