Comment by arcade79
10 hours ago
While reading this kind of articles, I'm always surprised by how small the storage described is. Given that Microsoft released their paper on LRCs in 2012, Google patented a bunch in 2010, facebook talked about their stuff around the 2010-2014 era too. CEPH started getting good erasure codes around 2016-2020.
Has any of the big ones released articles on their storage systems in the last 5-10 years?
IIRC, the most recent and most technical public content we (Google) have published on Colossus are these:
https://cloud.google.com/blog/products/storage-data-transfer...
https://cloud.google.com/blog/products/storage-data-transfer...
Facebook's published content on Tectonic is quite good and I think it's well more recent than 2010-14.
(Current Google employee, just pointing to public content, hope that's helpful.)
Nice, the L4 cache seem to be a newish addition. Love the detail about two filesystems with >10 exabytes of storage.
All the big ones have talked about their storage systems, but have been reluctant publishing papers like they used to do, so it appears to be more of a marketing focused effort than trying to share the technical details with the world.