← Back to context

Comment by ronfriedhaber

9 hours ago

> Just provisioning a new instance and copying the relevant checkpoints and things can take 25 minutes.

Modal significantly improves this. Highly recommend.

2 comments

ronfriedhaber

Reply
embedding-shape  9 hours ago

Is Modal at all similar to Vast.ai or just related because "It's for AI"? I looked at Modal's page for training, and it talks about using some SDK and other junk, can you not just get a beefy instance from Modal with tons of VRAM to do what you want with?

  • cmrdporcupine  8 hours ago

    Modal is more like AWS Lambda in a way. Computing functions as a service instead of an whole container or whole instance / GPU. Much more granular.