A popularity-aware cost-effective replication scheme for high data durability in cloud storage

Proceedings - 2016 IEEE International Conference on Big Data, Big Data 2016

Volumn , Issue , 2016, Pages 384-389

  Liu, Jinwei ^a   Shen, Haiying ^b  

^a AMRL   (United States)

^b University of Virginia   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH; BANDWIDTH COMPRESSION; BIG DATA; COST EFFECTIVENESS; COST REDUCTION; COSTS; DIGITAL STORAGE; DURABILITY;

CLOUD STORAGE SYSTEMS; COMPRESSION METHODS; COST EFFECTIVE; DATA POPULARITY; DELTA COMPRESSION; LOW PROBABILITY; MACHINE FAILURE; MULTI-FAILURES;

DATA REDUCTION;

EID: 85015238237     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2016.7840627     Document Type: Conference Paper

References (39)

1. Amazon S3. http://aws.amazon.com/s3 [accessed in Aug. 2016].
2. Google cloud storage. http://cloud.google.com/storage.
3. Windows azure. http://www.microsoft.com/windowsazure.
4. J. Colgrove, J. D. Davis, J. Hayes, E. L. Miller, C. Sandvig, R. Sears, A. Tamches, N. Vachharajani, and F. Wang. Purity: Building fast, highlyavailable enterprise flash storage from commodity components. In Proc. of SIGMOD, 2015.
5. J. Liu, H. Shen, and H. Narman. CCRP: Customized cooperative resource provisioning for high resource utilization in clouds. In Proc. of IEEE Big Data, Washington D.C., 2016.
6. J. Liu, H. Shen, and L. Chen. CORP: Cooperative opportunistic resource provisioning for short-lived jobs in cloud systems. In Proc. of IEEE Cluster, 2016.
7. B. Chun, F. Dabek, A. Haeberlen, E. Sit, H. Weatherspoon, M. Kaashoek, J. Kubiatowicz, and R. Morris. Efficient replica maintenance for distributed storage systems. In Proc. of NSDI, 2006.
8. A. Cidon, S. Rumble, R. Stutsman, S. Katti, J. Ousterhout, and M. Rosenblum. Copysets: Reducing the frequency of data loss in cloud storage. In Proc. of USENIX ATC, pages 37-48, 2013.
9. A. Cidon, R. Escriva, S. Katti, M. Rosenblum, and E. Gün Sirer. Tiered replication: A cost-effective alternative to full cluster geo-replication. In Proc. of USENIX ATC, pages 31-43, 2015.
10. J. Liu and H. Shen. A low-cost multi-failure resilient replication scheme for high data availability in cloud storage. In Proc. of HiPC, 2016.
11. S. Nath, H. Yu, P.B. Gibbons, and S. Seshan. Subtleties in tolerating correlated failures in wide-area storage systems. In NSDI, 2006.
12. M. Zhong, K. Shen, and J. Seiferas. Replication degree customization for high availability. In Proc. of EuroSys, 2008.
13. H. Shen, J. Liu, K. Chen, J. Liu, and S. Moyer. SCPS: A socialaware distributed cyber-physical human-centric search engine. IEEE Transactions on Computers (TC), 64:518-532, 2015.
14. K. Shvachko, H. Kuang, S. Radia, and R. Chansler. The Hadoop distributed file system. In Proc. of MSST, 2010.
15. D. Borthakur, J. Gray, J. Sarma, K. Muthukkaruppan, N. Spiegelberg, H. Kuang, K. Ranganathan, D. Molkov, A. Menon, S. Rash, R. Schmidt, and A. Aiyer. Apache Hadoop goes realtime at Facebook. In SIGMOD, 2011.
16. J. Liu and H. Shen. Dependency-aware and resource-efficient scheduling for heterogeneous jobs in clouds. In Proc. of CloudCom, 2016.
17. G. Ananthanarayanan, S. Agarwal, S. Kandula, A. Greenberg, I. Stoica, D. Harlan, and E. Harris. Scarlett: Coping with skewed content popularity in mapreduce clusters. In Proc. of EuroSys, Salzburg, 2011.
18. F. André, A. Kermarrec, E. Merrer, N. Scouarnec, G. Straub, and A. Kempen. Archiving cold data in warehouses with clustered network coding. In Proc. of EuroSys, 2014.
19. S. Balakrishnan, R. Black, A. Donnelly, P. England, A. Glass, D. Harper, S. Legtchenko, A. Ogus, E. Peterson, and A. Rowstron. Pelican: A building block for exascale cold data storage. In Proc. of OSDI, 2014.
20. J. Liu, H. Shen, and X. Zhang. A survey of mobile crowdsensing techniques: A critical component for the internet of things. In Proc. of ICCCN workshop on ContextQoS, 2016.
21. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In Proc. of SOSP, pages 29-43, 2003.
22. B. Calder, J. Wang, A. Ogus, N. Nilakantan, A. Skjolsvold, S. McKelvie, Y. Xu, S. Srivastav, J. Wu, H. Simitci, J. Haridas, C. Uddaraju, H. Khatri, A. Edwards, V. Bedekar, S. Mainali, R. Abbasi, A. Agarwal, M. Haq, M. Haq, D. Bhardwaj, S. Dayanand, A. Adusumilli, M. McNett, S. Sankaran, K. Manivannan, and L. Rigas. Windows azure storage: A highly available cloud storage service with strong consistency. In Proc. of SOSP, 2011.
23. N. Bonvin, T. Papaioannou, and K. Aberer. A self-organized, faulttolerant and scalable replication scheme for cloud storage. In SoCC'10.
24. L. Yan, K. Chen, H. Shen, and G. Liu. Mobilecopy: Resisting correlated node failures to enhance data availability in dtns. In SECON, 2015.
25. B. Wu, H. Shen, and K. Chen. Exploiting active sub-areas for multi-copy routing in vdtns. In Proc. of ICCCN, 2015.
26. A. Sarker, C. Qiu, H. Shen, A. Gil, J. Taiber, M. Chowdhury, J. Martin, M. Devine, and A. Rindos. An efficient wireless power transfer system to balance the state of charge of electric vehicles. In ICPP, 2016.
27. B. Wu, H. Shen, and K. Chen. Dial: A distributed adaptive-learning routing method in vdtns. In Proc. of IoTDI, 2016.
28. X. Lin, G. Lu, F. Douglis, P. Shilane, and G. Wallace. Migratory compression: Coarse-grained data reordering to improve compressibility. In Proc. of USENIX FAST, 2014.
29. N. Jain, M. Dahlin, and R. Tewari. Taper: Tiered approach for eliminating redundancy in replica synchronization. In FAST, 2005.
30. J. Kubiatowicz, D. Bindel, Y. Chen, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. Oceanstore: An architecture for global-scale persistent storage. In Proc. of ASPLOS, 2000.
31. M. Wittie, V. Pejovic, L. Deek, K. Almeroth, and B. Zhao. Exploiting locality of interest in online social networks. In CoNEXT, 2010.
32. J. Liu, H. Shen, and H. Hu. Load-aware and congestion-free state management in network function virtualization. In Proc. of ICNC, 2017.
33. S. Acedánski, S. Deb, M. Médard, and R. Koetter. How good is random linear coding based distributed networked storage. In NetCod, 2005.
34. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Widearea cooperative storage with cfs. In Proc. of SOSP, 2001.
35. P. Shilane, M. Huang, G. Wallace, and W. Hsu. Wan optimized replication of backup datasets using stream-informed delta compression. In Proc. of FAST, 2012.
36. Webserver workload. http://visa.lab.asu.edu/web/resources/traces/.
37. Y. Zhang, J. Yang, A. Memaripour, and S. Swanson. Mojim: A reliable and highly-available non-volatile memory system. In ASPLOS, 2015.
38. K. P. N. Puttaswamy, T. Nandagopal, and M. Kodialam. Frugal storage for cloud file systems. In Proc. of EuroSys, 2012.
39. J. Liu, L. Yu, H. Shen, Y. He, and J. Hallstrom. Characterizing data deliverability of greedy routing in wireless sensor networks. In Proc. of SECON, Seattle, June 2015.