Comment by RationPhantoms
11 hours ago
I don't want to get into blockchain-shenanigans but I did love the Folding@home model for democratized compute. Could spare cycles on GPUs at home be used for a P2P network of inferencing?
11 hours ago
I don't want to get into blockchain-shenanigans but I did love the Folding@home model for democratized compute. Could spare cycles on GPUs at home be used for a P2P network of inferencing?
Yeah! not building a blockchain but we are building a system similar to folding at home (also a fan of that) where if you choose to have your node process others peoples requests you will get credits that you can then use to spend on other people nodes on the network. This is so you can still be able to use models that may be too big for your own hardware when you need them. Overall goal being to prevent people getting priced out of AI and providing and alternative way of accessing these larger models.