Towards the design of optimal data redundancy schemes for heterogeneous cloud storage infrastructures

Computer Networks

Volumn 55, Issue 5, 2011, Pages 1100-1113

  Pamies Juarez, Lluis ^a   García López, Pedro ^a   Sánchez Artigas, Marc ^a   Herrera, Blas ^a  

^a UNIVERSITAT ROVIRA I VIRGILI   (Spain)

Author keywords

Cloud storage; Data availability; Distributed storage; Erasure codes

Indexed keywords

DATA AVAILABILITY; DATA REDUNDANCY; DATA STORAGE; DISTRIBUTED INFRASTRUCTURE; DISTRIBUTED REDUNDANCY; DISTRIBUTED STORAGE; END-USERS; ERASURE CODES; MEASURE DATA; OPTIMAL DATA; REDUNDANCY SCHEME; STORAGE COSTS; STORAGE INFRASTRUCTURE; STORAGE SERVICES; STORAGE SOLUTIONS;

AVAILABILITY; OPTIMIZATION; REDUNDANCY;

QUALITY ASSURANCE;

EID: 79952442905     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2010.11.004     Document Type: Article

References (39)

1. Amazon.com, 2009. Amazon S3. .
2. D.P. Anderson, Boinc: a system for public-resource computing and storage, in: Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing, 2004.
3. C. Blake, R. Rodrigues, High availability, scalable storage, dynamic peer networks: pick two, in: Proceedings of the Ninth Workshop on Hot Topics in Operating Systems (HOTOS), 2003.
4. W.J. Bolosky, J.R. Douceur, D. Ely, M. Theimer, Feasibility of a serverless distributed file system deployed on an existing set of desktop pcs, in: Proceedings of the 2000 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, 2000.
5. R. Campbell, I. Gupta, M. Heath, S.Y. Ko, M. Kozuch, M. Kunze, T. Kwan, K. Lai, H.Y. Lee, M. Lyons, D. Milojicic, D. O'Hallaron, Y.C. Soh, Open cirrus cloud computing testbed: federated data centers for open source systems and services research, in: Proceedings of the Usenix Workshop on Hot Topics on Cloud Computing (HotCloud'09), 2009.
6. A.L. Cauchy, Cours d'analyse de l'École Royale Polytechnique, premire partie: analyse algébrique, 1821.
7. Chandra, A., Weissman, J., 2009. Nebulas: Using distributed voluntary resources to build clouds, in: Proceedings of the Usenix Workshop on Hot Topics on Cloud Computing (HotCloud'09).
8. B.G. Chun, F. Dabek, A. Haeberlen, E. Sit, H. Weatherspoon, M.F. Kaashoek, J. Kubiatowicz, Efficient replica maintenance for distributed storage systems, machine availability estimation, in: Symposium on Networked Systems Design and Implementation (NSDI), 2006.
9. K. Church, A. Greenberg, J. Hamilton, On delivering embarrassingly distributed cloud services, in: Proceedings of Seventh Workshop on Hot Topics in Networks (HotNets), 2008.
10. CleverSafe, 2010, Cleversafe, .
11. L. Cox, B. Noble, Pastiche: making backup cheap and easy, in: Proceedings of Fifth USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2002.
12. A. Datta, K. Aberer, Internet-scale storage systems under churn. A study of the steady-state using markov models, in: Proceedings of the Sixth International Conference on Peer-to-Peer Computing (P2P), 2006.
13. Y. Deng, and F. Wang A heterogeneous storage grid enabled by grid service SIGOPS Oper. Syst. Rev. 41 1 2007 7 13
14. A. Dimakis, P. Godfrey, M. Wainwright, K. Ramchandran, Network coding for distributed storage systems, in: Proceedings of the 26th IEEE International Conference on Computer Communications (INFOCOM), 2007.
15. A. Duminuco, E.W. Biersack, Hierarchical codes: how to make erasure codes attractive for peer-to-peer storage systems, in: Proceedings of the Eighth International Conference on Peer-to-Peer Computing (P2P), 2008.
16. A. Duminuco, E.W. Biersack, T. En-Najjary, Proactive replication in distributed storage systems using machine availability estimation, in: Proceedings of the Third CoNEXT Conference (CONEXT), 2007.
17. M.L. Fakult, Peerstore: better performance by relaxing in peer-to-peer backup, in: Proceedings of the Fourth International Conference on Peer-to-Peer Computing (P2P), 2004.
18. B. Godfrey, Repository of availability traces, 2010, .
19. S. Guha, N. Daswani, R. Jain, An experimental study of the skype peer-to-peer voip system, in: Proceedings of the Fifth International Workshop on Peer-to-Peer Systems (IPTPS), 2006.
20. B. Javadi, D. Kondo, J. Vincent, D. Anderson, Mining for statistical availability models in large-scale distributed systems: an empirical study of seti@home, in: 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), 2009.
21. J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of the IEEE International Conference on Neural Networks, 1995.
22. R.B. Kiran, K. Tati, Y.-C. Cheng, S. Savage, G.M. Voelker, Total recall: system support for automated availability management, in: Symposium on Networked Systems Design and Implementation (NSDI), 2004.
23. D. Knuth, The Art of Computer Programming-Sorting and Searching, second ed., vol. 3, Addison-Wesley, 1998.
24. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, B. Zhao, Oceanstore: an architecture for global-scale persistent storage, in: Proceedings of the Ninth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2000.
25. W.K. Lin, D.M. Chiu, Y.B. Lee, Erasure code replication revisited, in: Proceedings of the Fourth International Conference on Peer-to-Peer Computing (P2P), 2004.
26. L. Pamies-Juarez, P. García-López, M. Sánchez- Artigas, Heterogeneity-aware erasure codes for peer-to-peer storage systems, in: Proceedings of the 38th IEEE International Conference on Parallel Processing (ICPP), 2009.
27. Rackspace, Mosso, 2009, .
28. A. Rajasekar, M. Wan, R. Moore, G. Kremenek, and T. Guptil Data grids, collections, and grid bricks MSS '03: Proceedings of the 20 th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03) 2003 IEEE Computer Society Washington, DC, USA 2
29. R. Rodrigues, B. Liskov, High availability in dhts: erasure coding vs. replication, in: Proceedings of the Fourth International Workshop on Peer-To-Peer Systems (IPTPS), 2005.
30. Y. Shi, R.C. Eberhart, Parameter selection in particle swarm optimization, in: Proceedings of the Seventh International Conference on Evolutionary Programming (EP), 1998.
31. E. Sit, A. Haeberlen, F. Dabek, B. Chun, H. Weatherspoon, R. Morris, M.F. Kaashoek, J. Kubiatowicz, Proactive replication for data durability, in: Proceedings of the Fifth International Workshop on Peer-to-Peer Systems (IPTPS), 2006.
32. standford.edu, Folding@home: distributing computing project, 2009, .
33. I. Stoica, R. Morris, D. Karger, F.M. Kaashoek, H. Balakrishnan, Chord: a scalable peer-to-peer lookup service for internet applications, in: Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM), 2001.
34. J. Stribling, Planetlab all pairs ping, 2010, .
35. L.M. Vaquero, L. Rodero-Merino, J. Caceres, and M. Lindner A break in the clouds: towards a cloud definition SIGCOMM Comput. Commun. Rev. 39 1 2009 50 55
36. H. Weatherspoon, J.D. Kubiatowicz, Erasure coding vs. replication: a quantitative comparison, in: Proceedings of the First International Workshop on Peer-To-Peer Systems (IPTPS), 2002.
37. F. Wu, T. Qiu, Y. Chen, G. Chen, Redundancy schemes for high availability in dhts, in: Proceedings of the Third International Symposium on Parallel and Distributed Processing and Applications (ISPA), 2005.
38. WuaLa, 2010, Wuala, .
39. Z. Zhang, Q. Lian, Reperasure: replication protocol using erasure-code in peer-to-peer storage network, in: Proceedings of the 21st Symposium on Reliable Distributed Systems (SRDS), 2002.