Live deduplication storage of virtual machine images in an open-source cloud

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7049 LNCS, Issue , 2011, Pages 81-100

  Ng, Chun Ho ^a   Ma, Mingcao ^a   Wong, Tsz Yeung ^a   Lee, Patrick P C ^a   Lui, John C S ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Deduplication; experimentation; file system; implementation; open source cloud; virtual machine image storage

Indexed keywords

DEDUPLICATION; EXPERIMENTATION; FILE SYSTEMS; IMPLEMENTATION; OPEN-SOURCE; VIRTUAL MACHINES; DE DUPLICATIONS; OPEN SOURCES;

COMPUTER OPERATING SYSTEMS; COMPUTER SIMULATION; EXPERIMENTS; METADATA; DIGITAL STORAGE; FILE ORGANIZATION; MIDDLEWARE;

MIDDLEWARE; OPEN SYSTEMS;

EID: 83755228939     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-25821-3_5     Document Type: Conference Paper

References (28)

1. Amazon EC2, http://aws.amazon.com/ec2
2. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A View of Cloud Computing. Comm. of the ACM 53(4), 50-58 (2010)
3. Bhagwat, D., Eshghi, K., Long, D., Lillibridge, M.: Extreme binning: Scalable, parallel deduplication for chunk-based file backup. In: Proc. IEEE MASCOTS, pp. 1-9. IEEE (2009)
4. Bloom, B.H.: Space/Time Trade-offs in Hash Coding with Allowable Errors. Communications of the ACM (1970)
5. Btrfs, http://btrfs.wiki.kernel.org
6. Cao, M., Tso, T., Pulavarty, B., Bhattacharya, S., Dilger, A., Tomas, A.: State of the art: Where we are with the ext3 filesystem. In: Proc. of the Ottawa Linux Symposium, OLS (2005)
7. Clements, A., Ahmad, I., Vilayannur, M., Li, J.: Decentralized deduplication in SAN cluster file systems. In: Proc. USENIX ATC (2009)
8. Debnath, B., Sengupta, S., Li, J.: ChunkStash: Speeding Up Inline Storage Deduplication Using Flash Memory. In: Proc. USENIX ATC (2010)
9. Dubnicki, C., Gryz, L., Heldt, L., Kaczmarczyk, M., Kilian, W., Strzelczak, P., Szczepkowski, J., Ungureanu, C., Welnicki, M.: Hydrastor: A scalable secondary storage. In: Proc. USENIX FAST (2009)
10. Hansen, J.G., Jul, E.: Lithium: Virtual Machine Storage for the Cloud. In: Proc. of ACM SOCC (2010)
11. Jin, K., Miller, E.L.: The effectiveness of deduplication on virtual machine disk images. In: Proc. ACM SYSTOR (2009)
12. Kruus, E., Ungureanu, C., Dubnicki, C.: Bimodal content defined chunking for backup streams. In: Proc. USENIX FAST, page 18. USENIX Association (2010)
13. Liguori, A., Van Hensbergen, E.: Experiences with Content Addressable Storage and Virtual Disks. In: WIOV 2008 (2008)
14. Lillibridge, M., Eshghi, K., Bhagwat, D., Deolalikar, V., Trezise, G., Camble, P.: Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality. In: Proc. USENIX FAST (2009)
15. Meister, D., Brinkmann, A.: Dedupv1: Improving deduplication throughput using solid state drives (SSD). In: Proc. IEEE MSST (2010)
16. Muthitacharoen, A., Chen, B., Mazières, D.: A low-bandwidth network file system. In: Proc. of ACM SOSP (2001)
17. Nath, P., Kozuch, M.A., O'Hallaron, D.R., Harkes, J., Satyanarayanan, M., Tolia, N., Toups, M.: Design Tradeoffs in Applying Content Addressable Storage to Enterprise-scale Systems Based on Virtual Machines. In: Proc. USENIX ATC (2006)
18. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The Eucalyptus Open-source Cloud Computing System. In: Proc. of IEEE CCGrid (2009)
19. Offline Deduplication for Btrfs, http://www.spinics.net/lists/linux- btrfs/msg07818.html
20. OpenDedup. NBU for vSphere (December 2010), http://code.google.com/p/ opendedup/downloads/detail?name=SDFScture.pdf
21. OpenSolaris. ZFS Dedup FAQ (Community Group zfs.dedup) - XWiki (December 2010), http://hub.opensolaris.org/bin/view/Community+Group+zfs/dedup
22. OpenStack, http://www.openstack.org
23. Quinlan, S., Dorward, S.: Venti: a new approach to archival storage. In: Proc. USENIX FAST (2002)
24. Rhea, S., Cox, R., Pesterev, A.: Fast, inexpensive content-addressed storage in foundation. In: Proc. USENIX ATC (2008)
25. Ristenpart, T., Tromer, E., Shacham, H., Savage, S.: Hey, You, Get Off of My Cloud: Exploring Information Leakage in Third-Party Compute Clouds. In: Proc. of ACM CCS (2009)
26. Seagate. 7200-RPM Drive Specification Comparison, http://www.seagate.com/ docs/pdf/whitepaper/mb578 7200 drive specification comparison.pdf
27. Ungureanu, C., Atkin, B., Aranya, A., Gokhale, S., Rago, S., Calkowski, G., Dubnicki, C., Bohra, A.: HydraFS: a High-Throughput File System for the HYDRAstor Content-Addressable Storage System. In: Proc. of USENIX FAST (2010)
28. Zhu, B., Li, K., Patterson, H.: Avoiding the disk bottleneck in the data domain deduplication file system. In: Proc. USENIX FAST (2008)