Comment by dgellow
19 hours ago
It would be really funny if Anthropic engs run open weight models locally when they need to fix Claude API issues :)
19 hours ago
It would be really funny if Anthropic engs run open weight models locally when they need to fix Claude API issues :)
Or just their own models locally, since 8x GPU pods fit under a desk (makes a nice foot heater too)
It's been a while since I messed with serious hardware, what's the cooling noise level? I guess they have to be water cooled or the rack format 8u ones would be about 100db
My 4x 15k rpm 1U fans I use to cool my twin AMD V620s make a horrible racket, especially how they resonate with the rest of the workstation's case fans. Similar in volume and annoyance to running an 8" circular saw. I can only imagine it would probably be as bad or worse than that.
2 replies →