Comment by ActorNightly

2 days ago

Basically a docker image that can be hosted in the cloud (or on public facing machine), that allows you to "connect" any device, including your phone, to any other device. Kinda like ngrok but at the application layer. The idea is that you have a library that integrates with your web service running on localhost that defines an API, which then is publically accessible (with authentication) on the cloud container.

The use case would be just being able to interface with your stuff at home without a 3d party solution, in a programmatic way. So you can offload LLM inference, access stuff on your local network, and so on.

Additionally, the docker image should include ways to mesh with other instances, so you can form at hoc networks of devices.

Sounds like ngrok SDKs (https://ngrok.com/categories/sdks), but its closed source so I guess falls foul of your 3rd party solution comment.

Another option could be zrok (https://zrok.io/), which is an alternative that is open source, and also includes SDKs - https://blog.openziti.io/the-zrok-sdk.

I work on its parent project, OpenZiti, which also may fit your idea. Either way, its a programmatic way to embed connectivity into your app, making it accessible anywhere, but only to people who have authenticated and authorised, its others invisible.