Near duplicate detection in an academic digital library

DocEng 2013 - Proceedings of the 2013 ACM Symposium on Document Engineering

Volumn , Issue , 2013, Pages 91-94

  Williams, Kyle ^a   Giles, C Lee ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

near duplicate detection; shingles; simhash

Indexed keywords

ALGORITHMS; BUILDING MATERIALS;

CITESEER; DUPLICATE DETECTION; NEAR- DUPLICATES; NEAR-DUPLICATE DETECTION; PERFORMANCE AND APPLICATIONS; SHINGLES; SIMHASH; STATE OF THE ART;

DIGITAL LIBRARIES;

EID: 84887373179     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2494266.2494312     Document Type: Conference Paper

References (8)

1. A. Broder, S. Glassman, M. Manasse, and G. Zweig. Syntactic Clustering of the Web. Computer Networks and ISDN Systems, 29(8-13):1157-1166, Sept. 1997.
2. M. Charikar. Similarity Estimation Techniques from Rounding Algorithms. In Proceedings of the 34th Annual ACM Symposium on Theory of Computing, pages 380-388, 2002.
3. A. Chowdhury, O. Frieder, and D. Grossman. Collection Statistics for Fast Duplicate Document Detection. ACM Transactions on Information Systems, 20(2):171-191, 2002.
4. M. Henzinger. Finding Near-Duplicate Web Pages. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 284-291, Aug. 2006.
5. P. Lakkaraju, S. Gauch, and M. Speretta. Document Similarity Based on Concept Tree Distance. Proceedings of the 19th ACM Conference on Hypertext and Hypermedia, pages 127-132, 2008.
6. G. Manku, A. Jain, and A. D. Sarma. Detecting Near-Duplicates for Web Crawling. Proceedings of the 16th International Conference on World Wide Web, pages 141-149, 2007.
7. L. Padmasree, V. Ambati, J. Chandulal, and M. Rao. Signature Based Duplication Detection in Digital Libraries. Signature, 2006.
8. I. Z. Yalniz, E. F. Can, and R. Manmatha. Partial Duplicate Detection for Large Book Collections. Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pages 469-474, 2011.