CHARM: A Cost-Efficient Multi-Cloud Data Hosting Scheme with High Availability

IEEE Transactions on Cloud Computing

Volumn 3, Issue 3, 2015, Pages 372-386

  Zhang, Quanlu ^a   Li, Shenglong ^a   Li, Zhenhua ^b   Xing, Yuanjian ^c   Yang, Zhi ^a   Dai, Yafei ^a  

^a PEKING UNIVERSITY   (China)

^b TSINGHUA UNIVERSITY   (China)

^c NANJING RESEARCH INSTITUTE OF ELECTRONICS TECHNOLOGY   (China)

Author keywords

cloud storage; data hosting; Multi cloud

Indexed keywords

AVAILABILITY; COSTS; ECONOMICS;

CLOUD STORAGES; COMPREHENSIVE ANALYSIS; DATA ACCESS PATTERNS; DATA HOSTING; MULTI-CLOUDS; PROTOTYPE EXPERIMENT; TRACE DRIVEN SIMULATION; TRANSITION PROCESS;

DIGITAL STORAGE;

EID: 84941009547     PISSN: None     EISSN: 21687161     Source Type: Journal    
DOI: 10.1109/TCC.2015.2417534     Document Type: Article

References (47)

1. Aliyun OSS (Open Storage Service). [Online]. Available: http://www.aliyun.com/product/oss, 2014.
2. Gartner: Top 10 cloud storage providers. [Online]. Available: http://www.networkworld.com/news/2013/010313-gartnercloud-storage-265459.html?page=1, 2013.
3. Z. Li, C. Jin, T. Xu, C. Wilson, Y. Liu, L. Cheng, Y. Liu, Y. Dai, and Z.-L. Zhang, "Towards network-level efficiency for cloud storage services," in Proc. ACM SIGCOMM Internet Meas. Conf., 2014, pp. 115-128.
4. Z. Li, C. Wilson, Z. Jiang, Y. Liu, B. Y. Zhao, C. Jin, Z.-L. Zhang, and Y. Dai, "Efficient batched synchronization in dropbox-like cloud storage services," in Proc.ACM/IFIP/USENIX 14th Int. Middleware Conf., 2013, pp. 307-327.
5. C. M. M. Erin Allen, "Library of congress and duracloud launch pilot program using cloud technologies to test perpetual access to digital content," Library Cong., News Releases. [Online]. Available: http://www.loc.gov/today/pr/2009/09-140.html, 2009.
6. A. Li, X. Yang, S. Kandula, and M. Zhang, "CloudCmp: Comparing public cloud providers," in Proc. ACM SIGCOMM Internet Meas. Conf., 2010, pp. 1-14.
7. Windows Azure Pricing Updates. [Online]. Available: http://azure.microsoft.com/en-us/updates/azure-pricing-updates/, 2014.
8. Google Cloud Platform Pricing Updates. [Online]. Available: http://googlecloudplatform.blogspot.com/2014/03/googlecloud-platform-live-blending-iaas-and-paas-moores-law-for-thecloud. html, 2014.
9. It's Official, the Nirvanix Cloud Storage Service is Shutting Down. [Online]. Available: http://techcrunch.com/2013/09/27/its-official-the-nirvanix-cloud-storage-service-is-shutting-down/, 2013.
10. Shutting Down Ubuntu One File Services. [Online]. Available: http://blog.canonical.com/2014/04/02/shutting-down-ubuntuone-file-services/, 2014.
11. Nirvanix Provides Cautionary Tale for Cloud Storage. [Online]. Available: http://www.forbes.com/sites/tomcoughlin/2013/09/30/nirvanix-provides-cautionary-tail-for-cloud-storage/, 2013.
12. Google Outages Damage Cloud Credibility. [Online]. Available: https://www.networkworld.com/news/2009/092409-googleoutages-damage-cloud.html, 2009.
13. Rackspace to issue as much as $3.5M in customer credits after outage. [Online]. Available: http://www.networkworld.com/news/2009/070609-rackspace-outage.html, 2009.
14. Summary of the amazon EC2 and amazon RDS service disruption in the US east region. [Online]. Available: http://aws.amazon. com/cn/message/65648/, 2011.
15. A. Bessani, M. Correia, B. Quaresma, F. Andr-e, and P. Sousa, "DepSky: Dependable and secure storage in a cloud-of-clouds," in Proc. 6th Conf. Comput. Syst., 2013, pp. 31-46.
16. H. Abu-Libdeh, L. Princehouse, and H. Weatherspoon, "RACS: A case for cloud storage diversity," in Proc. 1st ACM Symp. Cloud Comput., 2010, pp. 229-240.
17. DuraCloud. [Online]. Available: http://www.duracloud.org/, 2014.
18. Cloud Foundry. [Online]. Available: http://www.cloudfoundry. org/, 2014.
19. Apache Libcloud. [Online]. Available: http://libcloud.apache. org/, 2014.
20. AmazingStore. [Online]. Available: http://cn.amazingstore.org/, 2014.
21. S. Liu, X. Huang, H. Fu, and G. Yang, "Understanding data characteristics and access patterns in a cloud storage system," in Proc. 13th IEEE/ACM Int. Symp. Cluster, Cloud, Grid Comput., 2013, pp. 327-334.
22. P. Wendell, J. W. Jiang, M. J. Freedman, and J. Rexford, "Donar: Decentralized server selection for cloud services," in Proc. ACM SIGCOMM Conf., 2010, pp. 231-242.
23. H. H. Liu, Y. Wang, Y. R. Yang, H. Wang, and C. Tian, "Optimizing cost and performance for content multihoming," in Proc. ACM SIGCOMM Conf. Appl., Technol., Archit., Protocols Comput. Commun., 2012, pp. 371-382.
24. T. G. Papaioannou, N. Bonvin, and K. Aberer, "Scalia: An adaptive scheme for efficient multi-cloud storage," in Proc. Int. Conf. High Perform. Comput., Netw., Storage, Anal., 2012, p. 20.
25. J. S. Plank, "Erasure codes for storage systems: A brief primer," Usenix Mag., vol. 38, no. 6, pp. 44-50, 2013.
26. J. S. Plank, K. M. Greenan, and E. L. Miller, "Screaming fast galois field arithmetic using Intel SIMD instructions," in Proc. 11th USENIX Conf. File Storage Technol., 2013, pp. 299-306.
27. H. Weatherspoon and J. D. Kubiatowicz, "Erasure coding vs. replication: A quantitative comparison," in Proc. 1st Int. Workshop Peer-to-Peer Syst., 2002, pp. 328-338.
28. R. Rodrigues and B. Liskov, "High availability in DHTs: Erasure coding vs. replication," in Proc. 4th Int. Conf. Peer-to-Peer Syst., 2005, pp. 226-239.
29. I. M. Bomze, M. Budinich, P. M. Pardalos, and M. Pelillo, "The maximum clique problem," in Handbook of Combinatorial Optimization. New York, NY, USA: Springer, 1999, pp. 1-74.
30. B. W. Kernighan and S. Lin, "An efficient heuristic procedure for partitioning graphs," Bell Syst. Tech. J., vol. 49, no. 2, pp. 291-307, 1970.
31. M. A. Shah, M. Baker, J. C. Mogul, and R. Swaminathan, "Auditing to keep online storage services honest," in Proc. 11th USENIX Workshop Hot Topics Oper. Syst., 2007, p. 11.
32. E. Zhai, R. Chen, D. I. Wolinsky, and B. Ford, "Heading off correlated failures through independence-as-a-service," in Proc. 11th USENIX Conf. Oper. Syst. Des., Implementation, 2014, pp. 317-334.
33. C. Huang, H. Simitci, Y. Xu, A. Ogus, B. Calder, P. Gopalan, J. Li, and S. Yekhanin, "Erasure coding in windows azure storage," in Proc. USENIX Annu. Tech. Conf., 2012, p. 2.
34. M. Sathiamoorthy, M. Asteris, D. Papailiopoulos, A. G. Dimakis, R. Vadali, S. Chen, and D. Borthakur, "XORing elephants: novel erasure codes for big data," VLDB Endowment, vol. 6, no. 5, pp. 325-336, 2013.
35. X. Ma, "On the feasibility of data loss insurance for personal cloud storage," presented at the 6th USENIX Workshop Hot Topics Storage File Syst., Philadelphia, PA, USA, 2014.
36. K. Zhou, H. Wang, and C. Li, "Cloud storage technology and its applications," ZTE Commun., vol. 8, no. 4, pp. 27-30, 2010.
37. M. Vrable, S. Savage, and G. M. Voelker, "BlueSky: A cloudbacked file system for the enterprise," in Proc. USENIX Conf.File Storage Technol., 2012, p. 19.
38. M. Hajjat, X. Sun, Y.-W. E. Sung, D. Maltz, S. Rao, K. Sripanidkulchai, and M. Tawarmalani, "Cloudward bound: Planning for beneficial migration of enterprise applications to the cloud," in Proc. ACM SIGCOMM Conf., 2010, pp. 243-254.
39. B. Trushkowsky, P. Bod-?k, A. Fox, M. J. Franklin, M. I. Jordan, and D. A. Patterson, "The SCADS director: Scaling a distributed storage system under stringent performance requirements," in Proc. 9th USENIX Conf. File, Stroage Technol., 2011, p. 12.
40. H. V. Madhyastha, J. C. McCullough, G. Porter, R. Kapoor, S. Savage, A. C. Snoeren, and A. Vahdat, "scc: Cluster storage provisioning informed by application characteristics and SLAs," in Proc. USENIX Conf. File, Stroage Technol., 2012, p. 23.
41. Y. Zhao, H. Jiang, K. Zhou, Z. Huang, and P. Huang, "Meeting service level agreement cost-effectively for video-on-demand applications in the cloud," in Proc. IEEE INFOCOM, 2014, pp. 298-306.
42. Y. Hu, H. C. Chen, P. P. Lee, and Y. Tang, "NCCloud: Applying network coding for the storage repair in a cloud-of-clouds," in Proc. 10th USENIX Conf. File, Stroage Technol., 2012, p. 21.
43. M. Pitkanen, R. Moussa, M. Swany, and T. Niemi, "Erasure codes for increasing the availability of grid data storage," in Proc. Int. Conf. Internet Web Appl. Serv./Adv. Int. Conf. Telecommun., 2006, p. 185.
44. H. B. Ribeiro and E. Anceaume, "Datacube: A P2P persistent data storage architecture based on hybrid redundancy schema," in Proc. 18th Euromicro Int. Conf. Parallel, Distrib. Netw.-Based Process., 2010, pp. 302-306.
45. A. Duminuco and E. W. Biersack, "Hierarchical codes: A flexible trade-off for erasure codes in peer-to-peer storage systems," Peerto-Peer Netw. Appl., vol. 3, no. 1, pp. 52-66, 2010.
46. W. Lin, D. Chiu, and Y. Lee, "Erasure code replication revisited," in Proc. 4th Int. Conf. Peer-to-Peer Comput., 2004, pp. 90-97.
47. Y. Ma, T. Nandagopal, K. P. Puttaswamy, and S. Banerjee, "An ensemble of replication and erasure codes for cloud file systems," in Proc. IEEE INFOCOM, 2013, pp. 1276-1284.