Comment by jauntywundrkind
6 days ago
> Snapshots are proudly hosted on Cloudflare R2, a storage service optimized for fast, global scalable access to large datasets.
Little curious to hear how this goes for everyone. R2's promise of infinite egress feels huge. But there's some grumbles in HN threads here & there that folks tend to get forced into more expensive contracts after they actually start using R2. Folks downloading ~90GB data sets daily sounds… taxing.
It sounds like OSM themselves offer diffs? I assume there's something about the format of the diffs, something to do with indexing, that makes full daily refreshes compelling? I don't quite understand the excitement for this release; I'm not well versed here & it feels like I'm missing some key technical reasons why this would be popular.
It would be interesting to see how much you can push this. At $0.36/million requests, this would be $0.36 for 90PB of data. Serving 90PB from AWS S3 would cost over $5M if my calculations are correct. Has anyone tried serving petabytes of data from R2?
Not sure about petabytes, but pretty sure Brandon Liu of Protomaps is hosting all the daily protomaps extracts via R2. Not sure what the egress usage is.