A study of practical deduplication

Proceedings of FAST 2011: 9th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2011, Pages 1-13

  Meyer, Dutch T ^a,b   Bolosky, William J ^a  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

FILE ORGANIZATION; PERSONAL COMPUTERS;

BACKUP IMAGE; CONTENT DATA; DATA DE DUPLICATIONS; DE DUPLICATIONS; FILE SIZES; FILE SYSTEMS; MICROSOFT; SPACE SAVINGS;

DIGITAL STORAGE;

EID: 85077032135     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. th USENIX Conference on File and Storage Technologies, 2007.
2. th USENIX Conference on File and Storage Technologies, 2009.
3. th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2009.
4. B. Bloom. Space/time trade-offs in hash coding with allowable errors. Communications of the ACM 13(7): 422—426, 1970.
5. th USENIX Windows Systems Symposium, 2000.
6. A. Clements, I. Ahmad, M. Vilayannur, J. Li. Decentralized deduplication in SAN cluster file systems. In Proc. USENIX Annual Technical Conference, 2009.
7. th USENIX Conference on File and Storage Technology, 2011.
8. st USENIX Conference on File and Storage Technologies, 2002.
9. J. Douceur and W. Bolosky. A large-scale study of file-system contents. In Proc. 1999 ACM SIGMETRICS International Conference on Measurement and Modelling of Computer Systems, 1999.
10. th USENIX Conference on File and Storage Technologies, 2009.
11. th ACM Symposium on Operating Systems Principles, 2005.
12. P. Kulkarni, F. Douglis, J. LaVoie, and J. Tracey. Redundancy elimination within large collections of files. In Proc. USENIX 2004 Annual Technical Conference, 2004.
13. K. Jin and E. Miller. The effectiveness of deduplication on virtual machine disk images. In Proc. SYSTOR 2009: The Israeli Experimental Systems Conference, 2009.
14. th USENIX Conference on File and Storage Technologies, 2009.
15. A. Mathur, M. Cao, S. Bhattacharya, A. Dilger, A. Tomas, and L. Vivier. The new ext4 filesystem: current status and future plans. In Proc. of the Linux Symposium, June, 2007.
16. Microsoft Corporation. BackupRead Function. MSDN. [Online] 2010. [Cited: August 17, 2010.] http://msdn.microsoft.com/enus/library/aa362509(VS.85).aspx.
17. Microsoft Corporation. Description of the scheduled tasks in Widows Vista. Microsoft Support. [Online] July 8, 2010. [Cited: August 9, 2010.] http://support.microsoft.com/kb/939039.
18. Microsoft Corporation. Disabling Last Access Time in Windows Vista to Improve NTFS Perfomance. The Storage Team Blog. [Online] 2006. [Cited November 2, 2010.] http://blogs.technet.com/b/filecab/archive/2006/11/07/d isabling-last-access-time-in-windows-vista-to-improventfs-performance.aspx.
19. Microsoft Corporation. File systems. Microsoft TechNet. [Online] 2010. [Cited: August 9, 2010.] http://technet.microsoft.com/enus/library/cc938929.aspx.
20. Microsoft Corporation. Volume Shadow Copy Service. MSDN. [Online] 2010. [Cited August 31, 2010.] http://msdn.microsoft.com/enus/library/bb968832(VS.85).aspx
21. D. R. Miller. Storage Economics: Four Principles for Reducing Total Cost of Ownership. Hitachi Corporate Web Site. [Online] May 2009. [Cited: August 17, 2010.] http://www.hds.com/assets/pdf/fourprinciples-for-reducing-total-cost-of-ownership.pdf.
22. th Workshop on Hot Topics in Operating Systems, 2009.
23. R. Nagar. Windows NT File System Internals. O'Reilly, 1997
24. C. Policroniades and I. Pratt. Alternatives for detecting redundancy in storage systems. In Proc. USENIX 2004 Annual Technical Conference, 2004.
25. M. Rabin. Fingerprinting by Random Polynomials. Harvard University Center for Research In Computing Technology Technical Report TR-CSE-03-01, 1981. Boston, MA.
26. R. Rivest. The MD5 Message-Digest Algorithm. [Online] April 1992. [Cited: August 17, 2010.] http://tools.ietf.org/rfc/rfc1321.txt.
27. th ACM Symposium on Operating Systems Principles, 1981.
28. M. Seltzer and K. Smith. File system aging: increasing the relevance of file system benchmarks. In Proc. 1997 ACM SIGMETRICS, June 1997.
29. A. Sweeney, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, and G. Peck. Scalability in the XFS file system. In Proc. 1996 USENIX Annual Technical Conference, 1996.
30. th ACM Symposium on Operating Systems Principles, 1999.
31. th USENIX Conference on File and Storage Technologies, 2010.
32. th USENIX Conference on File and Storage Technologies, 2010.
33. th USENIX Conference on File and Storage Technologies, 2008, pp. 1-14.