Comment by mitxela
8 hours ago
No that makes no sense. They only need a tiny device to act as a proxy. It makes no sense to colocate the expensive GPUs
8 hours ago
No that makes no sense. They only need a tiny device to act as a proxy. It makes no sense to colocate the expensive GPUs
Yeah, the usual approach here is to offer a free VPN service, and then piggyback traffic over the user’s internet provider. Much, much more scalable and cheaper than offering to put GPUs at a user’s home.
You can offer them a free anything, really. It's a pretty convenient way to pay, that mostly doesn't affect the user at all (unless their connection is very slow), but generates value.
"value"
Wow, that's genius. Basically, user gets a VPN but so does provider, in a sense.
It makes sense when someone else is paying for the power. The AI capabilities of mobile cpus is for pushing cloud based AI to your device. You pay the power bill while retaining the same lack of privacy as cloud hosted AI.
I'm pretty sure the company that owns the compute is the one paying for the power. Who would agree to have an ugly noisy cube in their property that they have to pay maintenance for? What would they get out of that deal?