I/O deduplication: Utilizing content similarity to improve I/O performance

Proceedings of FAST 2010: 8th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2010, Pages 211-224

  Koller, Ricardo ^a   Rangaswami, Raju ^a  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTENT SIMILARITY; CONTENT-BASED; DE DUPLICATIONS; DISK I/O; DYNAMIC REPLICA; PROTOTYPE IMPLEMENTATIONS; STORAGE OPTIMIZATION; STORAGE SYSTEMS;

DIGITAL STORAGE;

EID: 85077056058     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. Sedat Akyurek and Kenneth Salem. Adaptive Block Rearrangement. Computer Systems, 13(2):89-121, 1995.
2. Jens Axboe. blktrace user guide, February 2007.
3. Medha Bhadkamkar, Jorge Guerra, Luis Useche, Sam Burnett, Jason Liptak, Raju Rangaswami, and Vagelis Hristidis. BORG: Block-reORGanization for Self-optimizing Storage Systems. In Proc. of the USENIX File and Storage Technologies, February 2009.
4. Dina Bitton and Jim Gray. Disk Shadowing. In Proc. of the International Conference on Very Large Data Bases, 1988.
5. Burton H. Bloom. Space/time trade-offs in hash coding with allowable errors. Communications of the ACM, 13(7):422-426, 1970.
6. Sergey Brin, James Davis, and Hector Garcia-Molina. Copy Detection Mechanisms for Digital Documents. In Proc. of ACM SIGMOD, May 1995.
7. Austin Clements, Irfan Ahmad, Murali Vilayannur, and Jinyuan Li. Decentralized deduplication in san cluster file systems. In Proc. of the USENIX Annual Technical Conference, June 2009.
8. Daniel Ellard, Jonathan Ledlie, Pia Malkani, and Margo Seltzer. Passive NFS Tracing of Email and Research Workloads. In Proc. of the USENIX Conference on File and Storage Technologies, March 2003.
9. EMC Corporation. EMC Invista. http://www.emc.com/products/software/invista/invista.jsp.
10. Binny S. Gill. On multi-level exclusive caching: offline optimality and why promotions are better than demotions. In Proc. of the USENIX File and Storage Technologies, Feburary 2008.
11. Jim Gray and Prashant Shenoy. Rules of Thumb in Data Engineering. Proc. of the IEEE International Conference on Data Engineering, February 2000.
12. Jorge Guerra, Luis Useche, Medha Bhadkamkar, Ricardo Koller, and Raju Rangaswami. The Case for Active Block Layer Extensions. ACM Operating Systems Review, 42(6), October 2008.
13. Diwaker Gupta, Sangmin Lee, Michael Vrable, Stefan Savage, Alex C. Snoeren, George Varghese, Geoffrey Voelker, and Amin Vahdat. Difference Engine: Harnessing Memory Redundancy in Virtual Machines. Proc. of the USENIX OSDI, December 2008.
14. Windsor W. Hsu, Alan Jay Smith, and Honesty C. Young. The Automatic Improvement of Locality in Storage Systems. ACM Transactions on Computer Systems, 23(4):424-473, Nov 2005.
15. Hai Huang, Wanda Hung, and Kang G. Shin. FS2: Dynamic Data Replication In Free Disk Space For Improving Disk Performance And Energy Consumption. In Proc. of the ACM SOSP, October 2005.
16. IBM Corporation. IBM System Storage SAN Volume Controller. http://www03.ibm.com/systems/storage/software/virtualization/svc/.
17. N. Jain, M. Dahlin, and R. Tewari. TAPER: Tiered Approach for Eliminating Redundancy in Replica Synchronization. In Proc. of the USENIX Conference on File And Storage Systems, 2005.
18. Song Jiang, Feng Chen, and Xiaodong Zhang. Clock-pro: An effective improvement of the clock replacement. In Proc. of the USENIX Annual Technical Conference, April 2005.
19. P. Kulkarni, F. Douglis, J. D. LaVoie, and J. M. Tracey. Redundancy Elimination Within Large Collections of Files. Proc. of the USENIX Annual Technical Conference, 2004.
20. Andrew Leung, Shankar Pasupathy, Garth Goodson, and Ethan Miller. Measurement and Analysis of Large-Scale Network File System Workloads. Proc. of the USENIX Annual Technical Conference, June 2008.
21. Xuhui Li, Ashraf Aboulnaga, Kenneth Salem, Aamer Sachedina, and Shaobo Gao. Second-tier cache management using write hints. In Proc. of the USENIX File and Storage Technologies, 2005.
22. Mark Lillibridge, Kave Eshghi, Deepavali Bhagwat, Vinay Deolalikar, Greg Trezise, and Peter Camble. Sparse indexing: large scale, inline deduplication using sampling and locality. In Proc. of the USENIX File and Storage Technologies, February 2009.
23. R. L. Mattson, J. Gecsei, D. R. Slutz, and I. L. Traiger. Evaluation techniques for storage hierarchies. IBM Systems Journal, 9(2):78-117, 1970.
24. Nimrod Megiddo and D. S. Modha. Arc: A self-tuning, low overhead replacement cache. In Proc. of USENIX File and Storage Technologies, 2003.
25. G. Milos, D. G. Murray, S. Hand, and M. Fetterman. Satori: Enlightened Page Sharing. In Proc. of the Usenix Annual Technical Conference, June 2009.
26. Charles B. Morrey III and Dirk Grunwald. Peabody: The Time Travelling Disk. In Proc. of the IEEE/NASA MSST, 2003.
27. Athicha Muthitacharoen, Benjie Chen, and David Mazières. A low-bandwidth network file system. In Proc. of the ACM SOSP, October 2001.
28. Network Appliance, Inc. NetApp V-Series of Heterogeneous Storage Environments. http://media.netapp.com/documents/v-series.pdf.
29. Cyril U. Orji and Jon A. Solworth. Doubly distorted mirrors. In Proceedings of the ACM SIGMOD, 1993.
30. S. Quinlan and S. Dorward. Venti: A New Approach to Archival Storage. Proc. of the USENIX File And Storage Technologies, January 2002.
31. Sean Rhea, Russ Cox, and Alex Pesterev. Fast, Inexpensive Content-Addressed Storage in Foundation. Proc. of USENIX Annual Technical Conference, June 2008.
32. C. Ruemmler and J. Wilkes. Disk Shuffling. Technical Report HPL-CSP-91-30, Hewlett-Packard Laboratories, October 1991.
33. Jon A. Solworth and Cyril U. Orji. Distorted Mirrors. Proc. of PDIS, 1991.
34. Niraj Tolia, Michael Kozuch, Mahadev Satyanarayanan, Brad Karp, and Thomas Bressoud. Opportunistic use of content addressable storage for distributed file systems. Proc. of the USENIX Annual Technical Conference, 2003.
35. Paul Vongsathorn and Scott D. Carson. A System for Adaptive Disk Rearrangement. Softw. Pract. Exper., 20(3):225-242, 1990.
36. Carl A. Waldspurger. Memory Resource Management in VMware ESX Server. Proc. of USENIX OSDI, 2002.
37. C. K. Wong. Minimizing Expected Head Movement in One-Dimensional and Two-Dimensional Mass Storage Systems. ACM Computing Surveys, 12(2):167-178, 1980.
38. Theodore M. Wong and John Wilkes. My Cache or Yours? Making Storage More Exclusive. In Proc. of the USENIX Annual Technical Conference, 2002.
39. X. Yu, B. Gum, Y. Chen, R. Y. Wang, K. Li, A. Krishnamurthy, and T. E. Anderson. Trading Capacity for Performance in a Disk Array. Proc. of USENIX OSDI, 2000.
40. C. Zhang, X. Yu, A. Krishnamurthy, and R. Y. Wang. Configuring and Scheduling an Eager-Writing Disk Array for a Transaction Processing Workload. In Proc. of USENIX File and Storage Technologies, January 2002.
41. Benjamin Zhu, Kai Li, and Hugo Patterson. Avoiding the Disk Bottleneck in the Data Domain Deduplication File System. Proc. of the USENIX File And Storage Technologies, February 2008.