Decentralized deduplication in SAN cluster file systems

Proceedings of the 2009 USENIX Annual Technical Conference

Volumn , Issue , 2019, Pages 101-114

  Clements, Austin T ^b   Ahmad, Irfan ^a   Vilayannur, Murali ^a   Li, Jinyuan ^a  

^a VMWARE INC   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE;

BLOCK LAYOUT; CENTRALIZED COMPONENTS; CLUSTER FILE SYSTEMS; DATA BLOCKS; DE DUPLICATIONS; FILE SYSTEMS; STORAGE ARRAYS; STORAGE SPACES;

FILE ORGANIZATION;

EID: 85077030674     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. W. J. Bolosky, S. Corbin, D. Goebel, and J. R. Douceur. Single instance storage in Windows® 2000. In Proceedings of the 4th USENIX Windows Systems Symposium (WSS'00), Seattle, WA, Aug. 2000. USENIX.
2. Dell, Inc. DVD Store. http://delltechcenter.com/page/DVD+store.
3. J. Douceur, A. Adya, W. Bolosky, P. Simon, and M. Theimer. Reclaiming space from duplicate files in a serverless distributed file system. In Proceedings of the 22nd International Conference on Distributed Computing Systems (ICDCS'02), Vienna, Austria, July 2002. IEEE.
4. C. Dubnicki, L. Gryz, L. Heldt, M. Kaczmarczyk, W. Kilian, P. Strzelczak, J. Szczepkowski, C. Ungureanu, and M. Welnicki. Hydrastor: A scalable secondary storage. In Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST'09), San Francisco, CA, Feb. 2009. USENIX.
5. EMC Centera datasheet. http://www.emc.com/products/detail/hardware/centera.htm.
6. R. Fagin, J. Nievergelt, N. Pippenger, and H. R. Strong. Extendible hashing-a fast access method for dynamic files. ACM Transactions on Database Systems, 4(3), Sept. 1979.
7. A. Gulati, C. Kumar, and I. Ahmad. Storage workload characterization and consolidation in virtualized environments. In 2nd International Workshop on Virtualization Performance: Analysis, Characterization, and Tools (VPACT), 2009.
8. B. Hong, D. Plantenberg, D. D. E. Long, and M. Sivan-Zimet. Duplicate data elimination in a SAN file system. In Proceedings of the 21st Symposium on Mass Storage Systems (MSS'04), Goddard, MD, Apr. 2004. IEEE.
9. Iometer. http://www.iometer.org/.
10. A. Liguori and E. V. Hensbergen. Experiences with content addressable storage and virtual disks. In Proceedings of the Workshop on I/O Virtualization (WIOV'08), San Diego, CA, Dec. 2008. USENIX.
11. J. Menon, D. A. Pease, R. Rees, L. Duyanovich, and B. Hillsberg. IBM storage tank-a heterogeneous scalable SAN file system. IBM Systems Journal, 42(2), 2003.
12. P. Nath, M. A. Kozuch, D. R. O'Hallaron, J. Harkes, M. Satyanarayanan, N. Tolia, and M. Toups. Design tradeoffs in applying content addressable storage to enterprise-scale systems based on virtual machines. In Proceedings of the USENIX Annual Technical Conference (ATEC'06), Boston, MA, June 2006. USENIX.
13. P. Nath, B. Urgaonkar, and A. Sivasubramaniam. Evaluating the usefulness of content addressable storage for high-performance data intensive applications. In Proceedings of the 17th High Performance Distributed Computing (HPDC'08), Boston, MA, June 2008. ACM.
14. Netapp Deduplication (ASIS). http://www.netapp.com/us/products/platform-os/dedupe.html.
15. K. W. Preslan, A. P. Barry, J. E. Brassow, G. M. Erickson, E. Nygaard, C. J. Sabol, S. R. Soltis, D. C. Teigland, and M. T. O'Keefe. A 64-bit, shared disk file system for Linux. In Proceedings of the 16th Symposium on Mass Storage Systems (MSS'99), San Diego, CA, Mar. 1999. IEEE.
16. S. Quinlan and S. Dorward. Venti: A new approach to archival data storage. In Proceedings of the 1st USENIX Conference on File and Storage Technologies (FAST'02) [19].
17. S. Rhea, R. Cox, and A. Pesterev. Fast, inexpensive content-addressed storage in Foundation. In Proceedings of the USENIX Annual Technical Conference (ATEC'08), Boston, MA, June 2008. USENIX.
18. F. Schmuck and R. Haskin. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the 1st USENIX Conference on File and Storage Technologies (FAST'02) [19].
19. USENIX. The 1st USENIX Conference on File and Storage Technologies (FAST'02), Monterey, CA, Jan. 2002.
20. M. Vilayannur, P. Nath, and A. Sivasubramaniam. Providing tunable consistency for a parallel file store. In Proceedings of the 4th USENIX Conference on File and Storage Technologies (FAST'05), San Francisco, CA, Dec. 2005. USENIX.
21. VMware, Inc. VMFS datasheet. http://www.vmware.com/pdf/vmfs_datasheet.pdf.
22. VMware, Inc. Recommendations for aligning VMFS partitions. Technical report, Aug. 2006.
23. VMware, Inc. Introduction to VMware Infrastructure. 2007. http://www.vmware.com/support/pubs/.
24. VMware, Inc. VMware Virtual Desktop Infrastructure (VDI) datasheet, 2008. http://www.vmware.com/files/pdf/vdi_datasheet.pdf.
25. C. A. Waldspurger. Memory resource management in VMware ESX Server. In Proceedings of the 5th USENIX Symposium on Operating Systems Design and Implementation (OSDI'02), Boston, MA, Dec. 2002. USENIX.
26. B. Zhu, K. Li, and H. Patterson. Avoiding the disk bottleneck in the Data Domain deduplication file system. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST'08), San Jose, CA, Feb. 2008. USENIX.