Comment by kittikitti
20 hours ago
I'm not sure why someone hasn't developed a company offering services that distributes AI across all idle or under-utilized VM's and PC's for enterprises in order to serve open sourced models. Outside of the electricity bill, there's no additional expenditure and you get the AI.
We've all seen the office spaces where there's 200 empty computers on a floor. Combined, it's something like 500 cores at ~3 Ghz each and around 3 TB of RAM. The networking is already there and software like exo already exists.
Vibe code that app and business. It’s a great idea like a kind of SETI@Home for business but I’m not sure the compute and latency will really be good enough unless you’re talking about a business with literally thousands of machines sitting half idle and always on, or always mostly on. i imagine it would take maybe 50-100 MacBook Pros running such a service to get to Claude level performance for one or two people.
Is there some mock input one could calculate to actually verify that? That many modern Mac Pros is no small potatoes when it comes to compute power. Someone must have a pre made formula anyone can use to do closer estimates?
Really not sure, the numbers aren’t too hard to run. GPUs in particular are really not doing very much most of the time. But spinning them up does max out the machine and make it hot and increase the power consumption quite a lot so it would be obvious the machine is getting stressed out all the time compared to its quiet idle background which is where it’s at for most browsing and basic stuff.
I have not seen this. The one time I did it was after a major layoff. People use laptops and take them home. I'm not saying it's not viable but the scene you depict I think is outdated.