Comment by losfair

3 days ago

> Firstly, can there be an easier way to stop a microVM mid execution in this single executable bottlefire format and then rerun that and it would start mid execution. (something akin to how criu does it?)

Not yet - Firecracker supports snapshotting so this should be doable though!

> if something like microvm could be run in normal cloud infrastructure?

Some cloud providers - like GCP and DigitalOcean - do support nested virtualization, and they work pretty well with Firecracker. Using VM migration to run stable workloads on spot instances sounds very interesting :)

7 comments

losfair

Reply
tuananh  3 days ago

> Some cloud providers - like GCP and DigitalOcean - do support nested virtualization, and they work pretty well with Firecracker. Using VM migration to run stable workloads on spot instances sounds very interesting :)

not necessarily. you can build custom kernel with pvm[1] and do it on aws.

[1]: https://lwn.net/Articles/963718/

  • Imustaskforhelp  3 days ago

    Yes I also came to know across pvm. I feel like doing it on top of aws instances can bring a really nice way of migrating from spot isntances and paying less bills.

    What are your thoughts on the other hand in using criu with docker and then deploying it on aws spot instances, is it possible

    • tuananh  3 days ago

      > What are your thoughts on the other hand in using criu with docker and then deploying it on aws spot instances, is it possible

      I don't see why not really

      but the last few years, spot has been reclaimed way too often and the price discount is not as good as it used to be (era 2016-2017) so I prefer to use saving plan now. although quite a big portion of our fleet still use spot.

      1 reply →

Imustaskforhelp  3 days ago

I genuinely hope that you can please consider the 1st question regarding snapshotting and its doability in bottlefire's / bake's roadmap.

Regarding the 2nd question, I feel like something can definitely be crafted that can enable running stable workloads on gcp/digitalocean spot instances and maybe what bake can do is really make the automation aspect of spot instances / VM migration easier...

Please don't get me wrong, this project looks really cool but I would actually like a first hand response as to (preferably) why this/bake project was created and when/why should someone use this..

I also have many more questions and I feel like haivng a community place can be really helpful here.

Although my open source purist heart wishes for you to use matrix, Its also understandable if you use discord. Do note that there are bridges so you could technically have both matrix and discord and bridge them.

Best wishes for your project.