Multi-level selective deduplication for VM snapshots in cloud storage

Proceedings - 2012 IEEE 5th International Conference on Cloud Computing, CLOUD 2012

Volumn , Issue , 2012, Pages 550-557

  Zhang, Wei ^a   Tang, Hong ^b   Jiang, Hao ^b   Yang, Tao ^a   Li, Xiaogang ^b   Zeng, Yue ^b  

^a University of California   (United States)

^b ALIBABA GROUP   (United States)

Author keywords

Cloud storage backup; Distributed data deduplication; Virtual machine snap shots

Indexed keywords

COMPUTING ENVIRONMENTS; COMPUTING RESOURCE; DEDUPLICATION; DUPLICATE ELIMINATION; REDUNDANT CONTENT; RESOURCE REQUIREMENTS; VIRTUAL DISK; VIRTUAL MACHINES;

CLOUD COMPUTING; COMPUTER SYSTEMS;

DIGITAL STORAGE;

EID: 84866753149     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2012.78     Document Type: Conference Paper

References (20)

1. Aliyun Inc. http://www.aliyun.com.
2. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2/.
3. L. A. Adamic and B. A. Huberman. Zipfs law and the Internet. Glottometrics, 3(1):143-150, 2002.
4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. SIGOPS Oper. Syst. Rev., 37:164-177, Oct. 2003.
5. D. Bhagwat, K. Eshghi, D. D. E. Long, and M. Lillibridge. Extreme Binning: Scalable, parallel deduplication for chunk-based file backup. In Modeling, Analysis Simulation of Computer and Telecommunication Systems, 2009. MASCOTS '09. IEEE International Symposium on, pages 1-9, 2009.
6. L. Breslau, P. Cue, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web Caching and Zipf-like Distributions: Evidence and Implications. IN INFOCOM, pages 126 - 134, 1999.
7. A. T. Clements, I. Ahmad, M. Vilayannur, and J. Li. Decentralized deduplication in SAN cluster file systems. page 8, June 2009.
8. C. Dubnicki, L. Gryz, L. Heldt, M. Kaczmarczyk, W. Kilian, P. Strzelczak, J. Szczepkowski, C. Ungureanu, and M. Welnicki. HYDRAstor: a Scalable Secondary Storage. In FAST '09: Proccedings of the 7th conference on File and storage technologies, pages 197-210, Berkeley, CA, USA, 2009. USENIX Association.
9. B. Fitzpatrick. Distributed caching with memcached. Linux J., 2004:5-, Aug. 2004.
10. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezis, and P. Camble. Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality. In FAST, pages 111-123, 2009.
11. U. Manber. Finding similar files in a large file system. In Proceedings of the USENIX Winter 1994 Technical Conference, pages 1-10, 1994.
12. C.-H. Ng, M. Ma, T.-Y. Wong, P. P. C. Lee, and J. C. S. Lui. Live deduplication storage of virtual machine images in an open-source cloud. In Middleware, pages 81-100, 2011.
13. S. Quinlan and S. Dorward. Venti: A New Approach to Archival Storage. In FAST '02: Proceedings of the Conference on File and Storage Technologies, pages 89-101, Berkeley, CA, USA, 2002. USENIX Association.
14. M. O. Rabin. Fingerprinting by random polynomials. Technical Report TR-CSE-03-01, Center for Research in Computing Technology, Harvard University, 1981.
15. S. Rhea, R. Cox, and A. Pesterev. Fast, inexpensive content-addressed storage in foundation. In USENIX 2008 Annual Technical Conference on Annual Technical Conference, pages 143-156, Berkeley, CA, USA, 2008. USENIX Association.
16. Y. Tan, H. Jiang, D. Feng, L. Tian, and Z. Yan. Cabdedupe: A causality-based deduplication performance booster for cloud backup services. In IPDPS, pages 1266-1277, 2011.
17. M. Vrable, S. Savage, and G. M. Voelker. Cumulus: Filesystem backup to the cloud. Trans. Storage, 5:14:1-14:28, Dec. 2009.
18. A. Warfield, S. Hand, K. Fraser, and T. Deegan. Facilitating the development of soft devices. page 22, Apr. 2005.
19. W. Xia, H. Jiang, D. Feng, and Y. Hua. SiLo: a similarity-locality based near-exact deduplication scheme with low RAM overhead and high throughput. pages 26-28, June 2011.
20. B. Zhu, K. Li, and H. Patterson. Avoiding the disk bottleneck in the data domain deduplication file system. In FAST'08: Proceedings of the 6th USENIX Conference on File and Storage Technologies, pages 1-14, Berkeley, CA, USA, 2008. USENIX Association.