← Back to context

Comment by johnmaguire

3 months ago

Any good alternatives?

15 comments

johnmaguire

Reply
phpdave11  3 months ago

If you just need a simple local s3 server (e.g. for developing and testing), I recommend rclone.

rclone serve s3 path/to/buckets --addr :9000 --auth-key <key-id>,<secret>

ecshafer  3 months ago

A lot of them actually. Ceph personally I've used. But there's a ton, some open source, some paid. Backblaze has a product Buckets or something. Dell powerscale. Cloudian has one. Nutanix has one.

  • dardeaup  3 months ago

    Ceph is awesome for software defined storage where you have multiple storage nodes and multiple storage devices on each. It's way too heavy and resource intensive for a single machine with loopback devices.

  • coredog64  3 months ago

    I've been looking at microceph, but the requirement to run 3 OSDs on loopback files plus this comment from the docs gives me pause:

    `Be wary that an OSD, whether based on a physical device or a file, is resource intensive.`

    Can anyone quantify "resource intensive" here? Is it "takes an entire Raspberry Pi to run the minimum set" or is it "takes 4 cores per OSD"?

    Edit: This is the specific doc page https://canonical-microceph.readthedocs-hosted.com/stable/ho...

    • dardeaup  3 months ago

      Ceph has multiple daemons that would need to be running: monitor, manager, OSD (1 per storage device), and RADOS Gateway (RGW). If you only had a single storage device it would still be 4 daemons.

  • dathinab  3 months ago

    ceph depends a lot on your use case

    minio was also suited for some smaller use cases (e.g. running a partial S3 compatible storage for integration tests). Ceph isn't really good for it.

    But if you ran large minio clusters in production ceph might be a very good alternative.