Comment by krasin
2 days ago
DeepSeek R1 has 671B parameters. If you want to run at 8 bits/parameter (the native format for DeepSeek R1, in which it was trained, so the top performance possible for the model), one would need about 32 Blackhole p150a ([1]), which is around $42k and 10kW power consumption.
So, yes, you can run DeepSeek R1 on it, but there are cheaper options (if we only talk about inference).
No comments yet
Contribute on Hacker News ↗