An unsupervised heuristic-based approach for bibliographic metadata deduplication

Information Processing and Management

Volumn 47, Issue 5, 2011, Pages 706-718

  Borges, Eduardo N ^a   De Carvalho, Moisés G ^b   Galante, Renata ^a   Gonalves, Marcos André ^b   Laender, Alberto H F ^b  

^a FEDERAL UNIVERSITY OF RIO GRANDE DO SUL   (Brazil)

^b FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

Author keywords

Deduplication; Digital libraries; Metadata; Similarity

Indexed keywords

CONTENT AND STRUCTURE; DEDUPLICATION; DIGITAL OBJECTS; METADATA STANDARDS; SCIENTIFIC ARTICLES; SIMILARITY; SIMILARITY FUNCTIONS; STATE-OF-THE-ART METHODS; TRAINING PROCESS;

BIBLIOGRAPHIC RETRIEVAL SYSTEMS; DIGITAL LIBRARIES; GENETIC PROGRAMMING;

METADATA;

EID: 79960524941     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2011.01.009     Document Type: Article

References (31)

1. R. Baeza-Yates, and B. Ribeiro-Neto Modern information retrieval 1999 ACM Press/Addison-Wesley
2. Bilenko, M.; & Mooney, R. J. (2003). Adaptive duplicate detection using learnable string similarity measures. In Proceedings of the 9th ACM SIGKDD International conference on knowledge discovery and data mining (pp. 39-48). Washington, DC, USA.
3. Boser, B. E.; Guyon, I. M.; & Vapnik, V. N. (1992). A training algorithm for optimal margin classifiers. In Proceedings of the 5th Annual workshop on computational learning theory (pp. 144-152). Pittsburgh, PA, USA.
4. Carvalho, J. C. P.; & da Silva, A. S. (2003). Finding similar identities among objects from multiple web sources. In Proceedings of the 5th ACM International workshop on web information and data management (pp. 90-93). New Orleans, LA, USA. (Pubitemid 40673640)
5. Carvalho, M. G.; Gonalves, M. A.; Laender, A. H. F.; & da Silva, A. S. (2006). Learning to deduplicate. In Proceedings of the 6th Joint conference on digital libraries (pp. 41-50). Chapel Hill, NC, USA. (Pubitemid 46613746)
6. Carvalho, M. G.; Laender, A. H. F.; Gonalves, M. A.; & da Silva, A. S. (2008). Replica identification using genetic programming. In Proceedings of the 23rd ACM Symposium on applied computing (pp. 1801-1806). Fortaleza, CE, Brazil.
7. Chaudhuri, S.; Ganjam, K.; Ganti, V.; & Motwani, R. (2003). Robust and efficient fuzzy match for online data cleaning. In Proceedings of ACM SIGMOD international conference on management of data (pp. 313-324). San Diego, CA, USA.
8. Cohen, W. W.; Richman, J. (2002). Learning to match and cluster large high-dimensional data sets for data integration. In Proceedings of the 8th ACM SIGKDD International conference on knowledge discovery and data mining (pp. 475-480). Edmonton, AB, Canada.
9. Convis, D. B.; Glickman, D.; & Rosenbaum, W. S. (1982). Alpha content match prescan method for automatic spelling error correction. US Patent 4 328 561.
10. Cota, R.; Gonalves, M. A.; & Laender, A. H. F. (2007). A heuristic-based hierarchical clustering method for author name disambiguation in digital libraries. In Proceedings of the 21st Brazilian symposium on databases (pp. 20-34). João Pessoa, PB, Brazil.
11. A. Doan, N.F. Noy, and A.Y. Halevy Introduction to the special issue on semantic integration SIGMOD Record 33 4 2004 11 13
12. Dorneles, C. F.; Heuser, C. A.; Lima, A. E. N.; da Silva, A. S.; & de Moura, E. S. (2004). Measuring similarity between collection of values. In Proceedings of the 6th ACM International workshop on web information and data management (pp. 56-63). Washington, DC, USA. (Pubitemid 40673610)
13. C.F. Dorneles, M.F. Nunes, C.A. Heuser, V.P. Moreira, A.S. da Silva, and E.S. de Moura A strategy for allowing meaningful and comparable scores in approximate matching Informaion Systems 34 8 2009 673 689
14. R. Fagin, L.M. Haas, M.A. Hernández, R.J. Miller, L. Popa, and Y. Velegrakis Clio: Schema mapping creation and data exchange Conceptual modeling: Foundations and applications, Heidelberg, Germany LNCS 5600 2009 Springer 198 236
15. I.P. Fellegi, and A.B. Sunter A theory for record linkage Journal of the American Statistical Association 64 328 1969 1183 1210
16. E.A. Fox, R.M. Akscyn, R.K. Furuta, and J.J. Leggett Digital libraries Commununications of the ACM 38 4 1995 22 28
17. M.A. Gonalves, E.A. Fox, L.T. Watson, and N.A. Kipp Streams, structures, spaces, scenarios, societies (5s): A formal model for digital libraries ACM Transactions of the Information Systems 22 2 2004 270 312
18. G.J.A. Guth Surname spellings and computerized record linkage Historical Methods Newsletter 10 1 1976 10 19
19. A. Large, and J. Beheshti OPACS: A research review Library & Information Science Research 19 2 1997 111 133 (Pubitemid 127340749)
20. S. Lawrence, C.L. Giles, and K. Bollacker Digital libraries and autonomous citation indexing Computer 32 6 1999 67 71
21. V.I. Levenshtein Binary codes capable of correcting deletions, insertions and reversals Soviet Physics Doklady 10 8 1966 707 710
22. M. Ley The DBLP computer science bibliography: Evolution, research issues, perspectives Proceedings of the 9th International string processing and information retrieval symposium, Lisbon, Portugal LNCS 2476 2002 Springer 1 10
23. Lima, A. E. N. (2002). Pesquisa de similaridade em XML. Monografia de Graduaão em Ciência da Computaão, Instituto de Informática, UFRGS, Porto Alegre, RS, Brazil (in Portuguese).
24. C.D. Manning, P. Raghavan, and H. Schütze Introduction to information retrieval 2008 Cambridge University Press
25. A.K. McCallum, K. Nigam, J. Rennie, and K. Seymore Automating the construction of internet portals with machine learning Information Retrival 3 2 2000 127 163
26. J.R. Quinlan Induction of decision trees Machine Learning 1 1 1986 81 106
27. E. Rahm, and P.A. Bernstein A survey of approaches to automatic schema matching The VLDB Journal 10 4 2001 334 350 (Pubitemid 33570972)
28. S. Siegel Nonparametric statistics for the behavioral sciences 1956 McGraw-Hill
29. R.K. Stasiu, C.A. Heuser, and R. da Silva Estimating recall and precision for vague queries in databases Proceedings of the 17th international conference on advanced information systems engineering, Porto, Portugal LNCS vol. 3520 2005 Springer 187 200 (Pubitemid 41336103)
30. S. Tejada, C.A. Knoblock, and S. Minton Learning object identification rules for information integration Information System 26 8 2001 607 633 (Pubitemid 33046273)
31. F. Wilcoxon Individual comparisons by ranking methods Biometrics 1 1945 80 83