Applying syntactic similarity algorithms for enterprise information management

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2009, Pages 1087-1095

  Cherkasova, Ludmila ^a   Eshghi, Kave ^a   Morrey III, Charles B ^a   Tucek, Joseph ^a   Veitch, Alistair ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Document management; Performance; Syntactic similarity

Indexed keywords

CONTENT MANAGEMENT SOLUTIONS; CONTENT SIMILARITY; CONTENT-BASED; CONTROLLED ENVIRONMENT; DATA RETENTION; DOCUMENT MANAGEMENT; ENTERPRISE INFORMATION MANAGEMENT; HIGHLY SENSITIVE; NEAR-DUPLICATES; NEW APPLICATIONS; PERFORMANCE; PERFORMANCE STUDY; SAMPLING FREQUENCIES; SIMILARITY ALGORITHM; SIMILARITY METRICS; SLIDING WINDOW; TECHNICAL SUPPORT;

INFORMATION MANAGEMENT; INFORMATION SERVICES; KNOWLEDGE ENGINEERING; REGULATORY COMPLIANCE; SYNTACTICS;

ALGORITHMS;

EID: 70350645468     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1557019.1557137     Document Type: Conference Paper

References (20)

1. S. Brin, J. Davis, and H. Garcia-Molina. Copy detection mechanism for digital documents. Proc. of ACM SIGMOD International Conference on Management Data, May, 1995.
2. A. Broder. On the Resemblance and Containment of Documents. Proc. of IEEE Conf. on the Compression and Complexity of Sequences, June, 1997.
3. A. Broder, M. Charikar, A. Frieze, M. Mitzenmacher. Min-wise independent permutations. Proc. of the Thirtieth Annual ACM Symposium on Theory of Computing,q Dallas, Texas, USA, May, 1998.
4. A. Broder, S. Glassman, M. Manasse, G. Zweig. Syntactic clustering of the Web. Selected papers from the 6-th Intl. Conference on World Wide Web, Sept.1997, Santa Clara, CA, USA.
5. M. S. Charikar. Estimation technique from rounding algorithms. Proc. of 34th Annual ACM Symposium on Theory of Computing (STOC), May, 2002.
6. A. Chowdhury, O. Frieder, D. Grossman, and M. McCabe. Collection Statistics for Fast Duplicate Document Detection. ACM Transactions on Information Systems (TOIS), 20(2), April 2002.
7. D. Fetterly, M. Manasse, M. Najork. On the Evolution of Clusters of Near-Duplicate Web Pages. Journal of Web Engineering, vol.2, N.4, Oct, 2004.
8. D. Fetterly, M. Manasse, M. Najork. Detecting Phrase-Level Duplication on the World Wide Web. Proc. of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'05), Salvador, Brazil, Aug, 2005.
9. G. Forman, K. Eshghi, S. Chiocchetti. Finding Similar Files in Large Document Repositories. Proc of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2005.
10. N. Heintze. Scalable document fingerprinting. Proc. of the Second USENIX Workshop on Electronic Commerce, 1996.
11. V. Henson. An analysis of compare-by-hash. Proc. of the 9th conference on Hot Topics in Operating Systems (HotOS'03), Lihue, Hawaii, USA, 2003.
12. M. Henzinger. Finding near-duplicate web pages: a large-scale evaluation of algorithms. Proc. of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'06), Seattle, Washington, USA, 2006.
13. T. Hoad and J. Zobel. Methods for Identifying Versioned and Plagiarised Documents. Journal of the American Society for Information Science and Technology, vol. 54, 2002.
14. B. Jenkins. Hash Functions. "Algorithm Alley", Dr. Dobb's Journal, September, 1997, http://www.ddj.com/184410284
15. U. Manber. Finding similar files in a large file system. Proc. of the Winter 1994 USENIX Conference, 1994.
16. A. Muthitacharoen, B. Chen, and D. Mazieres. A low-bandwidth network file system. Proc. of the 18th ACM Symposium on Operating Systems Principles (SOSP'01), Banff, Canada, October 2001.
17. M.O. Rabin. Fingerprinting by random polynomials. Technical Report TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
18. N. Shivakumar and H. Garcia-Molina. Building a Scalable and Accurate Copy Detection Mechanism. Proc. of 1st ACM International Conference on Digital Libraries , March 1996.
19. N. Shivakumar and H.Garcia-Molina. Finding near-replicas of documents on the web. Proc. of Workshop on Web Databases (WebDB'96), Valencia, Spain, 1996.
20. A. Tridgell and P. Mackerras. The rsync algorithm. Technical Report TR-CS-96-05, Australian National University, 1996.