Efficient detection of large-scale redundancy in enterprise file systems

Operating Systems Review (ACM)

Volumn 43, Issue 1, 2009, Pages 84-91

  Forman, George ^a   Eshghi, Kave ^a   Suermondt, Jaap ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Data mining; Directory similarity and de duplication; File systems; Min hashing; Scalability; Set sketches; Storage management

Indexed keywords

DIRECTORY SIMILARITY AND DE-DUPLICATION; EFFICIENT DETECTION; EFFICIENT TECHNOLOGY; FILE SYSTEMS; MIN-HASHING; STORAGE MANAGEMENT;

SCALABILITY;

DATA MINING;

EID: 77952264233     PISSN: 01635980     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1496909.1496926     Document Type: Conference Paper

References (6)

1. Bolosky, W. J., Corbin, S., Goebel, D., and Douceur, J. R. 2000. Single instance storage in Windows® 2000. In Proceedings of the 4th Conference on USENIX Windows Systems Symposium - Volume4 (Seattle, Washington, Aug. 3-4, 2000). USENIX Association, Berkeley, CA, 2-2
2. Broder, A. Z., Charikar, M., Frieze, A. M., and Mitzenmacher, M. 2000. Min-wise-independent permutations. Journal of Computer and System Sciences. 60, 3 (Jun. 2000), 630-659.
3. Douceur, J., Adya, A., Bolosky, W., Simon, D., Theimer, M. 2002. Reclaiming Space from Duplicate Files in a Serverless Distributed File System. In the 22nd IEEE International Conference on Distributed Computing Systems (ICDCS'02).
4. th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (Chicago, Illinois, USA, August 21 - 24, 2005). KDD '05. ACM, New York, NY, 394-400.
5. Gantz, J. F. et al. 2007. The Expanding Digital Universe: A Forecast of Worldwide Information Growth Through 2010. IDC White Paper, Framingham, MA. June 22, 2007. www.idc.com
6. Simpson, D., and Hatcher, J. TIP survey reveals storage trends. InfoStor Europe, Dec. 2006. www.infostor.com