Comment by wincy

2 days ago

I thought this was somehow BitTorrent related. I read this article and am not really sure if this is something to be excited about? Can I run Deepseek R1 with whatever this is?

1 comment

wincy

Reply
krasin  2 days ago

DeepSeek R1 has 671B parameters. If you want to run at 8 bits/parameter (the native format for DeepSeek R1, in which it was trained, so the top performance possible for the model), one would need about 32 Blackhole p150a ([1]), which is around $42k and 10kW power consumption.

So, yes, you can run DeepSeek R1 on it, but there are cheaper options (if we only talk about inference).

1. https://tenstorrent.com/hardware/blackhole