DBLK: Deduplication for primary block storage

IEEE Symposium on Mass Storage Systems and Technologies

Volumn , Issue , 2011, Pages

  Tsuchiya, Yoshihiro ^a   Watanabe, Takashi ^a  

^a FUJITSU LABORATORIES LTD   (Japan)

Author keywords

deduplication; storage system

Indexed keywords

BLOOM FILTERS; COMPRESSION SYSTEM; DEDUPLICATION; DEVICE INTERFACES; IN-LINE; LOW LATENCY; STORAGE SYSTEM;

DATA STRUCTURES;

METADATA;

EID: 79960904176     PISSN: 21601968     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MSST.2011.5937237     Document Type: Conference Paper

References (22)

1. C. Alvarez, "NetApp deduplication for FAS and V-Series deployment and implementation guide," Technical ReportTR-3505, January 2010.
2. B. H. Bloom, "Space/time trade-offs in hash coding with allowable errors," Communications of the ACM 13, 7 (1970), pp. 422-426, 1970.
3. A. Z. Broder, "On the resemblance and containment of documents," Proceedings of the Compression and Complexity of Sequences 1997, pp. 21-29, 1997.
4. A. Broder and M. Mitzenmacher, "Network applications of Bloom filters: a survey," Internet Mathematics, 2002.
5. B. Chazelle, J. Kilian, R. Rubinfeld, and A. Tal, "The Bloomier filter: an efficient data structure for static support lookup tables," The fifteenth ACM-SIAM Symposium on Discrete Algorithms (SODA), Jan 2004.
6. B. Debnath, S. Sengupta and J. Li, "ChunkStash: speeding up inline storage deduplication using flash memory," The 2010 USENIX Annual Technical Conference, June 2010.
7. C. Dubnicki, L. Gryz, L. Heldt, M. Kaczmarczyk, W. Kilian, P. Strzelczak, J. Szczepkowski, C. Ungureanu, and M. Welnicki, "HYDRAstor: a scalable secondary storage," The 7th USENIX Conference on File and Storage Technologies (FAST '09), February 2009.
8. J. K. Edwards, D. Ellard, C. Everhart, R. Fair, E. Hamilton, A. Kahn, A. Kanevsky, J. Lentini, A. Prakash, K. A. Smith, and E. Zayas, "FlexVol: flexible, efficient file volume virtualization in WAFL," The 2008 USENIX Annual Technical Conference, June 2008.
9. T. Fujita, "Linux SCSI target famework", http://stgt. sourceforge.net/
10. N. Jain, M. Dahlin, and R. Tewari, "TAPER: tiered approach for eliminating redundancy in replica synchronization," The 4th USENIX Conference on File and Storage Technologies (FAST '05), December 2005.
11. P. Kulkarni, F. Douglis, J. Lavoie, and J. M. Tracey, "Redundancy elimination within large collections of files," The 2004 Usenix Annual Technical Conference, June-July 2004.
12. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezise and P. Camble, "Sparse indexing: large scale, inline deduplication using sampling and locality," The 7th USENIX Conference on File and Storage Technologies (FAST '09), February 2009.
13. U. Manber, "Finding similar files in a large file system," The Winter 1994 USENIX Technical Conference, January 1994.
14. D. Meister and A. Brinkmann, "dedupv1: improving deduplication throughput using solid state drives (SSD)," IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), May 2010.
15. D. T. Meyer and W. J. Bolosky, "A study of practical deduplication," The 9th USENIX conference on File and Storage Technologies (Fast '11), February 2011.
16. A. Muthitacharoen, B. Chen, and D. Mazieres, "A low-bandwidth network file system," The 18th ACM Symposium on Operating Systems Principles (SOSP), Banff, Alberta, Canada, October 2001.
17. Ocarina-networks, "The Ocarina ECOsystem: content-aware dedupe and compression," June 2009.
18. S. Quinlan and S. Dorward, "Venti: a new approach to archival storage," The First USENIX conference on File and Storage Technologies (Fast '02), January 2002.
19. M. O. Rabin, "Fingerprinting by random polynomials," Harvard University Technical report TR-15-81, 1981.
20. S. Rhea, R. Cox and A. Pesterev, "Fast, inexpensive content-addressed storage in Foundation," The 2008 USENIX Annual Technical Conference, June 2008.
21. S. C. Rhea and J. Kubiatowicz, "Probabilistic location and routing," IEEE Computer and Communications Societies (INFOCOM '02), June 2002.
22. B. Zhu, K.Li, and H. Patterson, "Avoiding the disk bottleneck in the Data Domain deduplication file system," The 6th USENIX Conference on File and Storage Technologies (FAST '08), February 2008.