Comment by dgellow
7 hours ago
A datacenter is about data. Your network of space router is in no way something a reasonable person would consider a datacenter... Even less an inference datacenter.
7 hours ago
A datacenter is about data. Your network of space router is in no way something a reasonable person would consider a datacenter... Even less an inference datacenter.
Why, because on board storage is too small and the compute nodes are underpowered? And that can't ever change? A reasonable person doesn't understand technology usually. That is increasingly an understanding left to the wizard class.
I mean people make clusters out of raspberry pis and minipcs.
There is nothing magical here, you definitely don’t need to be a wizard to understand the hardware necessary for AI inference. You can make nice little clusters with rpis, yes, there is nothing magical about that, it’s pretty much baremetal 101. But no, you cannot run any meaningful inference on that cluster.
Maybe look at what is inside a datacenters, the amount of power required is very large, and the hardware to run the inference + network isn’t small. Then try to see how much sending that to space cost
This only makes sense if the compute nodes only become more powerful in space in the future and not also on the ground.
> Why, because on board storage is too small and the compute nodes are underpowered?
Yes
> And that can't ever change?
It can, but but not for free. As the comment earlier in the thread was referring to, more computing power needs more cooling, and cooling in space is hard.
> A reasonable person doesn't understand technology usually.
What? Do you mean a layperson? Why does that matter when discussing the feasibility of space-based AI datacenters?
> That is increasingly an understanding left to the wizard class.
No, you can get there with a bachelor's degree in a relevant subject. Or just reading informative news sources.
> I mean people make clusters out of raspberry pis and minipcs.
So? What does that have to do with anything?