Tiered replication: A cost-effective alternative to full cluster geo-replication

Proceedings of the 2015 USENIX Annual Technical Conference, USENIX ATC 2015

Volumn , Issue , 2015, Pages 31-43

  Cidon, Asaf ^a   Escriva, Robert ^b   Katti, Sachin ^a   Rosenblum, Mendel ^a   Sirer, Emin Gün ^b  

^a STANFORD UNIVERSITY   (United States)

^b Department of Obstetrics Gynecology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COST EFFECTIVENESS; OPEN SYSTEMS;

ADDITIONAL DATUM; CLOUD STORAGE SYSTEMS; CORRELATED FAILURES; COST EFFECTIVE; DYNAMIC ENVIRONMENTS; REMOTE LOCATION; REPLICATION ALGORITHM; STORAGE SYSTEMS;

DIGITAL STORAGE;

EID: 85009140809     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. How isolated are availability zones from one another? http://aws.amazon.com/ec2/faqs/#How-isolated-are-Availability-Zones-from-one-another.
2. Intelligent block placement policy to decrease probability of data loss. https://issues.apache.org/jira/browse/HDFS-1094.
3. L. N. Bairavasundaram, G. R. Goodson, S. Pasupathy, and J. Schindler. An analysis of latent sector errors in disk drives. In Proceedings of the 2007 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '07, pages 289-300, New York, NY, USA, 2007. ACM.
4. M. Bakkaloglu, J. J. Wylie, C. Wang, and G. R. Ganger. On correlated failures in survivable storage systems. Technical report, DTIC Document, 2002.
5. D. Borthakur, J. Gray, J. S. Sarma, K. Muthukkaruppan, N. Spiegelberg, H. Kuang, K. Ranganathan, D. Molkov, A. Menon, S. Rash, R. Schmidt, and A. Aiyer. Apache Hadoop goes realtime at Facebook. In Proceedings of the 2011 international conference on Management of data, SIGMOD '11, pages 1071-1080, New York, NY, USA, 2011. ACM.
6. B. Calder, J. Wang, A. Ogus, N. Nilakantan, A. Skjolsvold, S. McKelvie, Y. Xu, S. Srivastav, J. Wu, H. Simitci, J. Haridas, C. Uddaraju, H. Khatri, A. Edwards, V. Bedekar, S. Mainali, R. Abbasi, A. Agarwal, M. F. u. Haq, M. I. u. Haq, D. Bhardwaj, S. Dayanand, A. Adusumilli, M. McNett, S. Sankaran, K. Manivannan, and L. Rigas. Windows Azure Storage: A highly available cloud storage service with strong consistency. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, SOSP '11, pages 143-157, New York, NY, USA, 2011. ACM.
7. R. J. Chansler. Data Availability and Durability with the Hadoop Distributed File System.;login: The USENIX Magazine, 37(1), February 2012.
8. B.-G. Chun, F. Dabek, A. Haeberlen, E. Sit, H. Weatherspoon, M. F. Kaashoek, J. Kubiatowicz, and R. Morris. Efficient replica maintenance for distributed storage systems. NSDI, 6:4-4, 2006.
9. A. Cidon, S. M. Rumble, R. Stutsman, S. Katti, J. Ousterhout, and M. Rosenblum. Copysets: Reducing the frequency of data loss in cloud storage. In Proceedings of the 2013 USENIX Conference on Annual Technical Conference, USENIX ATC'13, pages 37-48, Berkeley, CA, USA, 2013. USENIX Association.
10. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10, pages 143-154, New York, NY, USA, 2010. ACM.
11. J. Dean. Evolution and future directions of large-scale storage and computation systems at Google. In SoCC, page 1, 2010.
12. C. Dubnicki, L. Gryz, L. Heldt, M. Kaczmarczyk, W. Kilian, P. Strzelczak, J. Szczepkowski, C. Ungureanu, and M. Welnicki. HYDRAstor: A scalable secondary storage. In FAST, volume 9, pages 197-210, 2009.
13. R. Escriva, B. Wong, and E. G. Sirer. HyperDex: A distributed, searchable key-value store. In Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM '12, pages 25-36, New York, NY, USA, 2012. ACM.
14. D. Ford, F. Labelle, F. I. Popovici, M. Stokely, V.-A. Truong, L. Barroso, C. Grimes, and S. Quinlan. Availability in globally distributed storage systems. In Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation, OSDI'10, pages 1-7, Berkeley, CA, USA, 2010. USENIX Association.
15. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. In SOSP, pages 29-43, 2003.
16. A. Haeberlen, A. Mislove, and P. Druschel. Glacier: Highly durable, decentralized storage despite massive correlated failures. In IN PROC. OF NSDI, 2005.
17. C. Huang, H. Simitci, Y. Xu, A. Ogus, B. Calder, P. Gopalan, J. Li, and S. Yekhanin. Erasure coding in Windows Azure Storage. In Proceedings of the 2012 USENIX Conference on Annual Technical Conference, USENIX ATC'12, pages 2-2, Berkeley, CA, USA, 2012. USENIX Association.
18. W. Jiang, C. Hu, Y. Zhou, and A. Kanevsky. Are disks the dominant contributor for storage failures?: A comprehensive study of storage subsystem failure characteristics. Trans. Storage, 4 (3): 71-725, Nov. 2008.
19. R. Kotla, L. Alvisi, and M. Dahlin. SafeStore: A durable and practical storage system. In USENIX Annual Technical Conference, pages 129-142, 2007.
20. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, et al. Oceanstore: An architecture for global-scale persistent storage. ACM Sigplan Notices, 35(11):190-201, 2000.
21. C. Li, D. Porto, A. Clement, J. Gehrke, N. Preguicą, and R. Rodrigues. Making geo-replicated systems fast as possible, consistent when necessary. In Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation, OSDI'12, pages 265-278, Berkeley, CA, USA, 2012. USENIX Association.
22. R. Li, P. P. Lee, and Y. Hu. Degraded-first scheduling forMapReduce in erasure-coded storage clusters.
23. W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen. Stronger semantics for low-latency geo-replicated storage. In Symposium on Networked Systems Design and Implementation, 2013.
24. J. MacCormick, N. Murphy, V. Ramasubramanian, U. Wieder, J. Yang, and L. Zhou. Kinesis: A new approach to replica placement in distributed storage systems. ACM Transactions On Storage (TOS), 4 (4): 11, 2009.
25. S. Nath, H. Yu, P. B. Gibbons, and S. Seshan. Subtleties in tolerating correlated failures in wide-area storage systems. In NSDI, volume 6, pages 225-238, 2006.
26. E. Pinheiro, W.-D. Weber, and L. A. Barroso. Failure trends in a large disk drive population. In 5th USENIX Conference on File and Storage Technologies (FAST 2007), pages 17-29, 2007.
27. S. Quinlan and S. Dorward. Venti: A new approach to archival data storage. In Proceedings of the 1st USENIX Conference on File and Storage Technologies, FAST '02, Berkeley, CA, USA, 2002. USENIX Association.
28. K. Rashmi, N. B. Shah, D. Gu, H. Kuang, D. Borthakur, and K. Ramchandran. A solution to the network challenges of data recovery in erasure-coded distributed storage systems: A study on the Facebook warehouse cluster. In Presented as part of the 5th USENIXWorkshop on Hot Topics in Storage and File Systems. USENIX, 2013.
29. S. C. Rhea, P. R. Eaton, D. Geels, H. Weatherspoon, B. Y. Zhao, and J. Kubiatowicz. Pond: The oceanstore prototype. In FAST, volume 3, pages 1-14, 2003.
30. M. Sathiamoorthy, M. Asteris, D. Papailiopoulos, A. G. Dimakis, R. Vadali, S. Chen, and D. Borthakur. XORing elephants: Novel erasure codes for big data. In Proceedings of the 39th international conference on Very Large Data Bases, PVLDB'13, pages 325-336. VLDB Endowment, 2013.
31. B. Schroeder and G. A. Gibson. Disk failures in the real world: What does an mttf of 1, 000, 000 hours mean to you? In Proceedings of the 5th USENIX Conference on File and Storage Technologies, FAST '07, Berkeley, CA, USA, 2007. USENIX Association.
32. B. Schroeder, E. Pinheiro, and W.-D. Weber. DRAM errors in the wild: A large-scale field study. In Proceedings of the Eleventh International Joint Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '09, pages 193-204, New York, NY, USA, 2009. ACM.
33. K. Shvachko, H. Kuang, S. Radia, and R. Chansler. The hadoop distributed file system. Mass Storage Systems and Technologies, IEEE/NASA Goddard Conference on, 01-10, 2010.
34. E. Sit, A. Haeberlen, F. Dabek, B.-G. Chun, H. Weatherspoon, R. Morris, M. F. Kaashoek, and J. Kubiatowicz. Proactive replication for data durability. In IPTPS, 2006.
35. Y. Sovran, R. Power, M. K. Aguilera, and J. Li. Transactional storage for geo-replicated systems. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, pages 385-400. ACM, 2011.
36. E. Thereska, A. Donnelly, and D. Narayanan. Sierra: Practical power-proportionality for data center storage. Proceedings of Eurosys 11, pages 169-182, 2011.
37. R. van Renesse and F. B. Schneider. Chain replication for supporting high throughput and availability. In Proceedings of the 6th Conference on Symposium on Opearting Systems Design & Implementation-Volume 6, OSDI'04, pages 7-7, Berkeley, CA, USA, 2004. USENIX Association.
38. P. Yalagandula, S. Nath, H. Yu, P. B. Gibbons, and S. Seshan. Beyond availability: Towards a deeper understanding of machine failure characteristics in large distributed systems. In USENIX WORLDS, 2004.
39. Y. Zhang, R. Power, S. Zhou, Y. Sovran, M. K. Aguilera, and J. Li. Transaction chains: Achieving serializability with low latency in geo-distributed storage systems. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pages 276-291. ACM, 2013.
40. B. Zhu, K. Li, and H. Patterson. Avoiding the disk bottleneck in the Data Domain deduplication file system. In Proceedings of the 6th USENIX Conference on File and Storage Technologies, FAST'08, pages 181-1814, Berkeley, CA, USA, 2008. USENIX Association.