Comment by Andrew_sooter

Have you checked out [petals](https://petals.dev/) It’s doing the same thing, however the project is written in python and there can be some optimizations to make it much more faster.