Efficient duplicate record detection based on similarity estimation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6184 LNCS, Issue , 2010, Pages 595-607

  Li, Mohan ^a   Wang, Hongzhi ^a   Li, Jianzhong ^a   Gao, Hong ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Duplicate Detection; Heterogeneous Records; Record Similarity; Similarity Estimation

Indexed keywords

BASIC IDEA; BI-PARTITE GRAPH MATCHING; DATA PROCESSING AND ANALYSIS; DATA SOURCE; DUPLICATE DETECTION; DUPLICATE RECORD DETECTION; EFFICIENT METHOD; INFORMATION INTEGRATION SYSTEM; LOW RATES; SIMILARITY ESTIMATION;

DATA PROCESSING; ESTIMATION; GRAPH THEORY; INFORMATION ANALYSIS;

INFORMATION MANAGEMENT;

EID: 77955023483     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-14246-8_58     Document Type: Conference Paper

References (16)

1. Elmagarmid, A.K., Ipeirotis, P.G., Verykios, V.S.: Duplicate record detection: A survey. IEEE Transactions on Knowledge and Data Engineering (2007)
2. Ristad, E.S., Yianilos, P.N.: Learning String-Edit Distance. IEEE Transactions on Pattern Analysis and Machine Intelligence (May 1998)
3. Kuhn, H.W.: The hungarian method for the assignment problem. Naval res. Logist. Quart. (1955)
4. Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Indust. Appl. Math. (1957)
5. Bilenko, M., Mooney, R.J.: Adaptive duplicate detection using learnable string similarity measures. In: SIGKDD, pp. 39-48 (August 2003)
6. Chandel, Hassanzadeh, O., Koudas, N., et al.: Benchmarking declarative approximate selection predicates. In: SIGMOD, pp. 353-364 (June 2007)
7. Chaudhuri, S., Ganjam, K., Ganti, V., Motwani, R.: Robust and efficient fuzzy match for online data cleaning. In: SIGMOD, pp. 313-324 (June 2003)
8. Cohen, W.W.: Data integration using similarity joins and a word-based information representation language. ACM Trans. on Information Systems 18(3), 288-321 (2000)
9. Borkar, V.R., Deshmukh, K., Sarawagi, S.: Automatic segmentation of text into structured records. In: SIGMOD, pp. 175-186 (May 2001)
10. Sarawagi, S., Cohen, W.W.: Semi-markov conditional random fields for information extraction. In: NIPS (December 2004)
11. Viola, P.A., Narasimhan, M.: Learning to extract information from semi-structured text using a discriminative context free grammar. In: SIGIR, pp. 330-337 (August 2005)
12. Cohen, W.W., Sarawagi, S.: Exploiting dictionaries in named entity extraction: combining semi-markov extraction processes and data integration methods. In: SIGKDD, pp. 89-98 (August 2004)
13. Arasu, Chaudhuri, S., Kaushik, R.: Transformation-based framework for record matching. In: ICDE, pp. 40-49 (April 2008)
14. Arasu, Kaushik, R.: A Grammar-based Entity Representation Framework for Data Cleaning. In: SIGMOD, pp. 233-244 (June 2009)
15. Mohan, L., Hongzhi, W., Jianzhong, L., Hong, G.: Duplicate Record Detection Method Based on Optimal Bipartite Graph Matching. In: NDBC (October 2009)
16. Alpaydin, E.: Introduction to Machine Learning. MIT Press, Cambridge (2004)