Comment by NitpickLawyer
15 days ago
Perhaps a bit tangential on the subject, but in the same spirit - does anyone know of an open source self-hostable alternative to runpod/vast for managing your GPUs? Our small team has some bare metal servers and I'd like to try something light to manage / reserve instances w/ the convenience of a webui and a place where the team can see at a glance who is using what, and eventually some notes on how long each deployment is likely to take (self filled ofc).
we are using claudie(.io) together with ray. but we put a lot time into the infrastructure but we managed to cut our cost for a factor of 20x by doing this.