Exploiting Workload Characteristics and Service Diversity to Improve the Availability of Cloud Storage Systems

IEEE Transactions on Parallel and Distributed Systems

Volumn 27, Issue 7, 2016, Pages 2010-2021

  Mao, Bo ^a   Wu, Suzhen ^a   Jiang, Hong ^b,c  

^a XIAMEN UNIVERSITY   (China)

^b The University of Texas at Arlington   (United States)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Cloud of Clouds; Cost Efficiency; Dependability; Erasure Codes; Replication

Indexed keywords

AVAILABILITY; COST EFFECTIVENESS; COSTS; EFFICIENCY; FORWARD ERROR CORRECTION; NETWORK ARCHITECTURE; REDUNDANCY;

CLOUD STORAGE SERVICES; COST EFFICIENCY; DEPENDABILITY; ERASURE CODES; PROTOTYPE IMPLEMENTATIONS; REPLICATION; SERVICE LEVEL AGREEMENTS; WORKLOAD CHARACTERISTICS;

DIGITAL STORAGE;

EID: 84976412199     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2015.2475273     Document Type: Article

References (45)

1. E. Allen and C. M. Morris. (2009, Jul.). Library of congress and duracloud launch pilot program using cloud technologies to test perpetual access to digital content, in Proc. Library Congress, News Release [Online]. Available: http://www.loc.gov/today/pr/2009/09-140.html
2. (2014). Amazon S3 [Online]. Available: http://aws.amazon.com/s3/
3. H. Abu-Libdeh, L. Princehouse, H. Weatherspoon, "RACS: A case for cloud storage diversity," in Proc. ACM Symp. Cloud Comput., Jun. 2010, pp. 229-240.
4. A. Bessani, M. Correia, B. Quaresma, F. Andr-e, P. Sousa, "DepSky: Dependable and secure storage in a cloud-of-clouds," in Proc. 6th Eur. Conf. Comput. Syst., Apr. 2011, pp. 31-46.
5. (2014). The Worst Cloud Outages of 2014 [Online]. Available: http://www.cio.com/article/2597775/cloud-computing/162288-The-worst-c loud-outages-of-2014-so-far.html
6. (2014). Tim Cook Says Apple to Add Security Alerts for iCloud Users, the Wall Street Journal [Online]. Available: http://online. wsj.com/articles/tim-cook-says-apple-to-add-security-alerts-foricloud-users-1409880977
7. Y. Hu, H. Chen, P. Lee, Y. Tang, "NCCloud: Applying network coding for the storage repair in a cloud-of-clouds," in Proc/10th USENIX Conf. File Storage Technol., Feb. 2012, pp. 265-272.
8. B. Mao, H. Jiang, S. Wu, "Improving storage availability in cloud-of-clouds with hybrid redundant data distribution," in Proc. 29th IEEE Int. Parallel Distrib. Process. Symp., May 2015, pp. 633-642.
9. K. Rashmi, N. Shah, D. Gu, H. Kuang, D. Borthakur, K. Ramchandran, "A "Hitchhiker's" guide to fast and efficient data reconstruction in erasure-coded data centers," in Proc. ACM SIGCOMM Conf. Appl., Technol., Archit. Protocols Comput. Commun., Aug. 2014, pp. 331-342.
10. K. Rashmi, N. Shah, D. Gu, H. Kuang, D. Borthakur, K. Ramchandran, "A solution to the network challenges of data recovery in erasure-coded distributed storage systems: A study on the facebook warehouse cluster," in Proc. 5th USENIX Workshop Hot Topics File Storage Technol., Jun. 2013, pp. 1-5.
11. R. Villars, C. Olofson, M. Eastwood, "Big data: What it is and why you should care, white paper, IDC," Jun. 2011, http://www. admin-magazine.com/HPC/content/download/5604/49345/file/IDC-Big Data-whitepaper-final.pdf.
12. N. Agrawal, W. J. Bolosky, J. R. Douceur, J. R. Lorch, "A fiveyear study of file-system metadata," in Proc. 5th USENIX Conf. File Storage Technol., Feb. 2007, pp. 31-45.
13. A. Traeger, E. Zadok, N. Joukov, C. Wright, "A nine year study of file system and storage benchmarking," ACM Trans. Storage, vol. 48, no. 2, pp. 1-56, 2008.
14. (2014). DuraCloud Project [Online]. Available: http://www.duracloud. org/
15. (2014). Windows Azure [Online]. Available: http://www.windowsazure. cn/zh-cn/
16. (2014). Aliyun Open Storage Service [Online]. Available: http://www.aliyun.com/
17. (2014). RackSpace [Online]. Available: http://www.rackspace. com/cn/
18. J. Gahm and J. Mcknight, "Medium-size business server & storage priorities," Enterprise Strategy Group, Jun. 2008, http://www.esgglobal. com/research-reports/medium-size-business-server-storage-priorities/.
19. S. Wu, H. Jiang, D. Feng, L. Tian, B. Mao, "Improving availability of RAID-structured storage systems by workload outsourcing," IEEE Trans. Comput., vol. 60, no. 1, pp. 64-79, Jan. 2011.
20. (2014). EMC Presents Disaster Recovery Survey 2013 [Online]. Available: http://emea.emc.com/microsites/2011/emc-brssurvey/index.htm
21. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, M. Zaharia, "Above the clouds: A berkeley view of cloud computing," EECS Dept., Univ. of California, Berkeley, CA, USA, Tech. Rep. No. USB/EECS-2009-28, 2009.
22. Y. Wang, L. Alvisi, M. Dahlin, "Gnothi: Separating data and metadata for efficient and available storage replication," in Proc. USENIX Annu. Tech. Conf., Jun. 2012, pp. 413-424.
23. J. Lofstead, M. Polte, G. Gibson, S. Klasky, K. Schwan, R. Oldfield, M. Wolf, Q. Liu, "Six degrees of scientific data: Reading patterns for extreme scale science IO," in Proc. 20th Int. Symp. High Perform. Distrib. Comput., Jun. 2011, pp. 49-60.
24. Hadoop [Online]. Available: http://hadoop.apache.org/, 2014.
25. O. Khan, R. Burns, J. S. Plank, W. Pierce, C. Huang, "Rethinking erasure codes for cloud file systems: Minimizing I/O for recovery and degraded reads," in Proc. 10th USENIX Conf. File Storage Technol., Jan. 2012, pp. 251-264.
26. S. Wu, H. Jiang, D. Feng, L. Tian, B. Mao, "WorkOut: I/O workload outsourcing for boosting the RAID reconstruction performance," in Proc. 7th USENIX Conf. File Storage Technol., Feb. 2009, pp. 239-252.
27. S. Wu, H. Jiang, B. Mao, "IDO: Intelligent data outsourcing with improved RAID reconstruction performance in large-scale data centers," in Proc. 26th USENIX Large Installation Syst. Admin., Dec. 2012, pp. 17-32.
28. S. Wu, H. Jiang, B. Mao, "Proactive data migration for improved storage availability in large-scale data centers," IEEE Trans. Comput., vol. 64, no. 9, pp. 2637-2651, Sep. 2015.
29. (2014). China Education and Research Network [Online]. Available: http://www.edu.cn/english-1369/index.shtml
30. Internet Archive [Online]. Available: http://www.archive.org/, 2009.
31. (2010). Filesystem Benchmarking with PostMark from NetApp [Online]. Available: http://www.shub-internet.org/brad/FreeBSD/postmark.html
32. A. Banerjee, P. Wolkotte, R. Mullins, S. Moore, G. Smit, "An energy and performance exploration of network-on-chip architectures," IEEE Trans. Very Large Scale Integration Syst., vol. 17, no. 3, pp. 319-329, Mar. 2009.
33. K. D. Bowers, A. Juels, A. Oprea, "HAIL: A high-availability and integrity layer for cloud storage," in Proc. 16th ACM Conf. Comput. Commun. Security, Nov. 2009, pp. 187-198.
34. M. Li, C. Qin, P. P. C. Lee, "CDStore: Toward reliable, secure, cost-efficient cloud storage via convergent dispersal," in Proc. USENIX Annu. Tech. Conf., Jul. 2015, pp. 111-124.
35. D. Dobre, P. Viotti, M. Vukoli-c, "Hybris: Robust hybrid cloud storage," in Proc. ACM Symp. Cloud Comput., Nov. 2014, pp. 1-14.
36. D. Li, X. Liao, H. Jin, B. Zhou, Q. Zhang, "A new disk I/O model of virtualized cloud environment," IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 6, pp. 1129-1138, Jun. 2013.
37. X. Zhang, M. Tsugawa, Y. Zhang, H. Song, C. Cao, G. Huang, J. Fortes, "Towards model-defined cloud of clouds," in Proc. 17th Int. Conf. Model Driven Eng. Lang. Syst., Sep. 2014, pp. 41-45.
38. R. Zhou, H. Chen, T. Li, "Towards lightweight and swift storage resource management in big data cloud era," in Proc. 29th ACM Int. Conf. Supercomput., Jun. 2015, pp. 133-142.
39. J. Wilkes, R. Golding, C. Staelin, T. Sullivan, "The HP Auto-RAID hierarchical storage system," Operating Syst. Rev., vol. 29, no. 5, pp. 96-108, 1995.
40. K. Mogi and M. Kitsuregawa, "Hot mirroring: A method of hiding parity update penalty and degradation during rebuilds for RAID5," in Proc. ACM SIGMOD Int. Conf. Manage. Data, Jun. 1996, pp. 183-194.
41. B. Mao, H. Jiang, S. Wu, L. Tian, D. Feng, J. Chen, L. Zeng, "HPDA: A hybrid parity-based disk array for enhanced performance and reliability," ACM Trans. Storage, vol. 8, no. 1, pp. 1-20, 2012.
42. Y. Ma, T. Nandagopal, K. Puttaswamy, S. Banerjee, "An ensemble of replication and erasure codes for cloud file systems," in Proc. 32nd IEEE Int. Conf. Comput. Commun., Apr. 2013, pp. 1276-1284.
43. D. Patterson, G. Gibson, R. Katz, "A case for redundant arrays of inexpensive disks (RAID)," in Proc. ACM SIGMOD Int. Conf. Manage. Data, Jun. 1988, pp. 109-116.
44. B. Mao, H. Jiang, S. Wu, Y. Fu, L. Tian, "Read performance optimization for deduplication-based storage systems in the cloud," ACM Trans. Storage, vol. 10, no. 2, pp. 1-22, 2014.
45. B. Mao, H. Jiang, S. Wu, L. Tian, "POD: Performance oriented I/O deduplication for primary storage systems in the cloud," in Proc. 28th IEEE Int. Parallel Distrib. Process. Symp., May 2014, pp. 767-776.