Comment by firtoz
1 year ago
Would it be something like this?
> OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi
https://x.com/geerlingguy/status/1884994878477623485
I haven't tried it myself or haven't verified the creds, but seems exciting at least
That's 1.2 t/s for the 14B Qwen finetune, not the real R1. Unless you go with the GPU with the extra cost, but hardly anyone but Jeff Geerling is going to run a dedicated GPU on a Pi.
it's using a Raspberry Pi with a.... USD$1k gpu, which kinda defeat the purpose of using the RPI in the first place imo.
or well, I guess you save a bit on power usage.
I suppose it makes sense, for extremely GPU centric applications, that the pi be used essentially as a controller for the 3090.
Oh, I was naive to think that the Pi was capable of some kind of magic (sweaty smile emoji goes here)