Cooperative repair based on tree structure for multiple failures in distributed storage systems with regenerating codes

Proceedings of the 12th ACM International Conference on Computing Frontiers, CF 2015

Volumn , Issue , 2015, Pages

  Pei, Xiaoqiang ^a   Wang, Yijie ^a   Ma, Xingkong ^a   Fu, Yongquan ^a   Xu, Fangliang ^a  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

Author keywords

Multiple Failures; Network Traffic Cost; Regenerating Codes; Repair Efficiency

Indexed keywords

CODES (SYMBOLS); COMPUTER NETWORKS; COST BENEFIT ANALYSIS; COSTS; DATA COMMUNICATION SYSTEMS; DATA TRANSFER; DIGITAL STORAGE; ECONOMIC AND SOCIAL EFFECTS; EFFICIENCY; ELECTRONIC DATA INTERCHANGE; FORESTRY; MULTIPROCESSING SYSTEMS; REFORESTATION; REPAIR;

DATA EXCHANGE TECHNIQUES; DISTRIBUTED STORAGE SYSTEM; MULTIPLE FAILURES; NETWORK TRAFFIC; REGENERATING CODES; REPAIR EFFICIENCIES; SMALL-NETWORK NETWORKS; STATE-OF-THE-ART APPROACH;

TREES (MATHEMATICS);

EID: 84969802723     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2742854.2742869     Document Type: Conference Paper

References (22)

1. Zeroc. [online]. available:, http://www.zeroc.com/.
2. R. Bhagwan, K. Tati, Y. Cheng, S. Savage, and G. Voelker. Total recall: System support for automated availability management. In Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation, volume 1, pages 25-25, 2004.
3. V. R. Cadambe, C. Huang, and J. Li. Permutation code: Optimal exact-repair of a single failed node in MDS code based distributed storage systems. In IEEE International Symposium on Information Theory Proceedings, ISIT 2011, St. Petersburg, Russia, July 31-August 5, 2011, pages 1225-1229, 2011.
4. O. Dalle, F. Giroire, J. Monteiro, and S. Perennes. Analysis of failure correlation impact on peer-to-peer storage systems. In Peer-to-Peer Computing, 2009. P2P'09. IEEE Ninth International Conference on, pages 184-193. IEEE, 2009.
5. A. Dimakis and P. Godfrey. Network coding for distributed storage systems. Information Theory, IEEE Transactions on, 56(9):4539-4551, 2010.
6. A. Duminuco and E. Biersack. Hierarchical codes: How to make erasure codes attractive for peer-to-peer storage systems. In Peer-to-Peer Computing, 2008. P2P'08. Eighth International Conference on, pages 89-98. IEEE, 2008.
7. A. Duminuco and E. Biersack. A practical study of regenerating codes for peer-to-peer backup systems. In Distributed Computing Systems, 2009. ICDCS'09. 29th IEEE International Conference on, pages 376-384. IEEE, 2009.
8. Y. Hu, Y. Xu, X. Wang, C. Zhan, and P. Li. Cooperative recovery of distributed storage systems from multiple losses with network coding. Selected Areas in Communications, IEEE Journal on, 28(2):268-276, 2010.
9. C. Huang, M. Chen, and J. Li. Pyramid codes: Flexible schemes to trade space for access eiciency in reliable data storage systems. ACM Transactions on Storage (TOS), 9(1):3, 2013.
10. C. Huang, H. Simitci, Y. Xu, A. Ogus, B. Calder, P. Gopalan, J. Li, and S. Yekhanin. Erasure coding in windows azure storage. In USENIX Annual Technical Conference (USENIX ATC), 2012.
11. Z. Huang, E. Biersack, and Y. Peng. Reducing repair traic in p2p backup systems: Exact regenerating codes on hierarchical codes. ACM Transactions on Storage (TOS), 7(3):10, 2011.
12. J. Li, S. Yang, X. Wang, and B. Li. Tree-structured data regeneration in distributed storage systems with regenerating codes. In INFOCOM, 2010 Proceedings IEEE, pages 1-9. IEEE, 2010.
13. R. Li, J. Lin, and P. P. C. Lee. Core: Augmenting regenerating-coding-based recovery for single and concurrent failures in distributed storage systems. In IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013, May 6-10, 2013, Long Beach, CA, USA, pages 1-6, 2013.
14. X. Lu, H. Wang, J. Wang, J. Xu, and D. Li. Internet-based virtual computing environment: Beyond the data center as a computer. Future Generation Computer Systems, 29:309-322, 2011.
15. L. OpenStack. Openstack: The open source cloud operating system, 2012.
16. R. Rodrigues and B. Liskov. High availability in dhts: Erasure coding vs. replication. Peer-to-Peer Systems IV, pages 226-239, 2005.
17. M. Sathiamoorthy, M. Asteris, D. Papailiopoulos, A. G. Dimakis, R. Vadali, S. Chen, and D. Borthakur. Xoring elephants: Novel erasure codes for big data. In Proceedings of the 39th international conference on Very Large Data Bases, pages 325-336. VLDB Endowment, 2013.
18. W. Sun, Y. Wang, Y. Fu, and X. Pei. A discrete data dividing approach for erasure-code-based storage applications. In Service Oriented System Engineering (SOSE), 2014 IEEE 8th International Symposium on, pages 308-313. IEEE, 2014.
19. Y. Wang and S. Li. Research and performance evaluation of data replication technology in distributed storage systems. International Journal of Computers and Mathematics with Applications, 51(11):1625-1632, 2006.
20. Y. Wang, X. Li, X. Li, and Y. Wang. A survey of queries over uncertain data. Knowledge and information systems, 37(3):485-530, 2013.
21. Y. Wang and X. Ma. A general scalable and elastic content-based publish/subscribe service. IEEE Transactions on Parallel and Distributed Systems (TPDS), 2014.
22. S. Weidong, W. Yijie, and P. Xiaoqiang. Tree-structured parallel regeneration for multiple data losses in distributed storage systems based on erasure codes. Communications, China, 10(4):113-125, 2013.