Unsupervised duplicate detection using sample non-duplicates

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4244 LNCS, Issue , 2006, Pages 136-164

  Lehti, Patrick ^a   Fankhauser, Peter ^a  

^a FRAUNHOFER IPSI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; ERROR ANALYSIS; PROBLEM SOLVING; SET THEORY;

DOMAIN DEPENDENT APPROACHES; TRAINING SET;

OBJECT RECOGNITION;

EID: 38549144127     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11890591_5     Document Type: Conference Paper

References (35)

1. Fellegi, I.P., Sunter, A.B.: A theory for record linkage. Journal of the American Statistical Association 64 (1969) 1183-1210
2. Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall (2002)
3. Hernandez, M.A., Stolfo, S.J.: Real-world data is dirty: Data cleansing and the merge/purge problem. Data Mining and Knowledge Discovery 2 (1998) 9-37
4. Galhardas, H., Florescu, D., Shasha, D., Simon, E.: An extensible framework for data cleaning. In: Proceddings of the 16th International Conference on Data Engineering (ICDE '00). (2000) 312
5. Monge, A., Elkan, C.: An efficient domain independent algorithm for detecting approximately duplicate database records. In: In Proceedings of the SIGMOD Workshop on Data Mining and Knowledge Discovery. (1997)
6. Newcombe, H.B., Kennedy, J.M., Axford, S.J., James, A.P.: Automatic linkage of vital records. Science 130 (1959) 954-959
7. Winkler, W.E.: Using the em algorithm for weight computation in the fellegisunter model of record linkage. In: Proceedings of the Section on Survey Research Methods, American Statistical Association. (1988) 667-671
8. Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society, Series B 34 (1977) 1-38
9. Winkler, W.E.: Improved decision rules in the fellegi-sunter model of record linkage. In: Proceedings of the Section on Survey Research Methods, American Statistical Association. (1993) 274-279
10. Larsen, M.D., Rubin, D.B.: Alternative automated record linkage using mixture models. Journal of the American Statistical Association 79 (2001) 32-41
11. Ravikumar, P., Cohen, W.W.: A hierarchical graphical model for record linkage. In: AUAI '04: Proceedings of the 20th conference on Uncertainty in artificial intelligence, AUAI Press (2004) 454-461
12. Elfeky, M.G., Verykios, V.S., Elmargarid, A.K.: Tailor: A record linkage tool-box. In: Proceedings of the 18th International Conference on Data Engineering (ICDE'02), Washington, DC, USA, IEEE Computer Society (2002) 17
13. Cohen, W.W., Richman, J.: Learning to match and cluster large high-dimensional data sets for data integration. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2002), Edmonton, Alberta (2002)
14. Bilenko, M., Mooney, R.J.: Learning to combine trained distance metrics for duplicate detection in databases. Technical Report AI 02-296, Artificial Intelligence Laboratory, University of Texas at Austin, Austin, TX (2002)
15. Tejada, S., Knoblock, C.A., Minton, S.: Learning object identification rules for information integration. Information Systems Journal 26 (2001) 635-656
16. Sarawagi, S., Bhamidipaty, A.: Interactive deduplication using active learning. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2002), Edmonton, Alberta (2002)
17. Ananthakrishna, R., Chaudhuri, S., Ganti, V.: Eliminating fuzzy duplicates in data warehouses. In: Proceedings of the 28th International Conference on Very Large Data Bases(VLDB '02). (2002)
18. Parag, Domingos, P.: Multi-relational record linkage. In: Proceedings of the KDD-2004 Workshop on Multi-Relational Data Mining. (2004) 31-48
19. Dong, X., Halevy, A.Y., Madhavan, J.: Reference reconciliation in complex information spaces. In: SIGMOD Conference. (2005) 85-96
20. Bhattacharya, I., Getoor, L.: Deduplication and group detection using links. In: Proceedings of the KDD-2004 Workshop on Link Analysis and Group Detection. (2004)
21. Pasula, H., Marthi, B., Milch, B., Russell, S., Shpitser, I.: Identity uncertainty and citation matching. In: Advances in Neural Information Processing Systems 15, MIT Press (2003)
22. Ley, M.: DBLP computer science bibliography, (http://dblp.uni-trier.de/)
23. Fachinformationszentrum-Karlsruhe: CompuScience. (http://www.zblmath. fizkarlsruhe.de/cs/)
24. Cohen, W.W., Ravikumar, P., Fienberg, S.E.: A comparison of string metrics for matching names and records. In: Proceedings of the KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation, Washington, DC (2003) 13-18
25. Evert, S.: Computational approaches to collocations. (http://www. collocations.de/)
26. Church, K.W., Hanks, P.: Word association norms, mutual information and lexicography. Computational Linguistics 16 (1990) 22-29
27. Church, K.W., Gale, W., Hanks, P., Hindle, D.: Using statistics in lexical analysis. Lexical Acquisition: Using On-line Recources to Build a Lexicon (1991) 115-164
28. Sachs, L. In: Angewandte Statistik. Springer, Berlin (2004) 434-435
29. MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Math., Stat. and Prob. (1967) 281-296
30. Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. CAD-Integrated Circuits and Systems 13 (2000) 888-905
31. Lehti, P., Fankhauser, P.: A precise blocking method for record linkage. In: Proceedings of the 7th International Conference on Data Warehousing and Knowledge Discovery (DaWaK'05). (2005)
32. Baeza-Yates, R., Ribiero-Neto, B. In: Modern Information Retrieval. Addison Wesley (1999) 74-79
33. Chang, C.C., Lin, C.J.: Libsvm - a library for support vector machines, (http://www.csie.ntu.edu.tw/cjlin/libsvm/)
34. Cohen, W.W., Ravikumar, P., Fienberg, S.: Secondstring - an open-source java-based package of approximate string-matching techniques. (http://secondstring.sourceforge.net/)
35. Levenshtein, V.I.: Binary codes capable of correcting insertions and reversals. Soviet Physics Doklady 10 (1966) 707-710