Entity matching across heterogeneous data sources: An approach based on constrained cascade generalization

Data and Knowledge Engineering

Volumn 66, Issue 3, 2008, Pages 368-381

  Zhao, Huimin ^a   Ram, Sudha ^b  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Cascade generalization; Decision tree; Entity matching; Heterogeneous databases; Record linkage

Indexed keywords

CLASSIFICATION (OF INFORMATION); DECISION THEORY; DECISION TREES; HUMAN COMPUTER INTERACTION;

CASCADE GENERALIZATION; CLASSIFICATION ACCURACIES; CLASSIFICATION METHODS; DECISION BOUNDARIES; DECISION TREE TECHNIQUES; ELSEVIER (CO); EMPIRICAL EVALUATIONS; EVALUATION RESULTS; FEATURE SPACES; HETEROGENEOUS DATA SOURCES; MATCHING RULES; REAL WORLD; REAL-WORLD DATA; REPRESENTATIONAL BIAS; UNIVARIATE;

DECISION MAKING;

EID: 47849087202     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2008.04.007     Document Type: Article

References (66)

1. Bell G.B., and Sethi A. Matching records in a national medical patient index. Communications of the ACM 44 9 (2001) 83-88
2. I. Bhattacharya, L. Getoor, Iterative record linkage for cleaning and integration, in: Proceedings of the Ninth ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, 2004.
3. M. Bilenko, R.J. Mooney, Adaptive duplicate detection using learnable string similarity measures, in: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington DC, 2003, pp. 39-48.
4. Breiman L. Bagging predictors. Machine Learning 24 2 (1996) 123-140
5. Brodley C.E., and Utgoff P.E. Multivariate decision trees. Machine Learning 19 1 (1995) 45-77
6. C.D. Budzinsky, Automated spelling correction, Unpublished Report, Statistics Canada, Ottawa, 1991.
7. Chatterjee A., and Segev A. Rule based joins in heterogeneous databases. Decision Support Systems 13 3-4 (1995) 313-333
8. S. Chaudhuri, V. Ganti, R. Motwani, Robust identification of fuzzy duplicates, in: Proceedings of the International Conference on Data Engineering, Tokyo, Japan, 2005, pp. 865-876.
9. Chen A.L.P., Tsai P.S.M., and Koh J.L. Identifying object isomerism in multidatabase systems. Distributed and Parallel Databases 4 2 (1996) 143-168
10. Cohen J. Statistical Power Analysis for the Behavioral Sciences. revised ed. (1977), Academic Press, Orlando, FL
11. P.T. Davis, D.K. Elson, J.L. Klavans, Methods for precise named entity matching in digital collections, in: Proceedings of the 2003 Joint Conference on Digital Libraries, 2003, pp. 27-31.
12. Dey D. Record matching in data warehouses: a decision model for data consolidation. Operations Research 51 2 (2003) 240-254
13. Dey D., Sarkar S., and De P. A probabilistic decision model for entity matching in heterogeneous databases. Management Science 44 10 (1998) 1379-1395
14. Dey D., Sarkar S., and De P. A distance-based approach to entity reconciliation in heterogeneous databases. IEEE Transactions on Knowledge and Data Engineering 14 3 (2002) 567-582
15. Doan A., Lu Y., Lee Y., and Han J. Profile-based object matching for information integration. IEEE Intelligent Systems 18 5 (2003) 54-59
16. P. Domingos, A unified bias-variance decomposition and its applications, in: Proceedings of 17th International Conference on Machine Learning, 2000, pp. 231-238.
17. M.E. Fair, Record linkage in an information age society, in: Proceedings of Record Linkage Techniques - 1997, 1997, pp. 427-441.
18. Fellegi I.P., and Sunter A.B. A theory of record linkage. Journal of the American Statistical Association 64 328 (1969) 1183-1210
19. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: Proceedings of the Thirteenth International Conference on Machine Learning, 1996, pp. 148-156.
20. Gama J., and Brazdil P. Cascade generalization. Machine Learning 41 3 (2000) 315-343
21. M. Ganesh, J. Srivastava, T. Richardson, Mining entity-identification rules for database integration, in: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), 1996, pp. 291-294.
22. K. Gilhooly, Dirty data blights the bottom line, Computerworld, November 07, 2005.
23. I.J. Haimowitz, Ö. Gür-Ali, H. Schwarz, Integrating and mining distributed customer databases, in: Proceedings of the Third International Conference on Knowledge Discovery and Data Mining (KDD-97), 1997, pp. 179-182.
24. Hand D., Mannila H., and Smyth P. Principles of Data Mining (2001), MIT Press, Cambridge, MA
25. Hernández M.A., and Stolfo S.J. Real-world data is dirty: data cleansing and the merge/purge problem. Data Mining and Knowledge Discovery 2 1 (1998) 9-37
26. Hosmer D.W., and Lemeshow S. Applied Logistic Regression (2000), John Wiley & Sons Inc.
27. Kim W., and Seo J. Classifying schematic and data heterogeneity in multidatabase systems. IEEE Computer 24 12 (1991) 12-18
28. R. Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, in: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, 1995, pp. 1137-1143.
29. M. Kubat, S. Matwin, Addressing the curse of imbalanced training sets: Onesided sampling, in: Proceedings of the Fourteenth International Conference on Machine Learning, 1997, pp. 179-186.
30. W. Lam, R. Huang, P.-S. Cheung, Learning phonetic similarity for matching named entity translations and mining new translations, in: Proceedings of the Twenty-seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2004, pp. 289-296.
31. Luján-Mora S., and Palomar M. Reducing inconsistency in integrating data from different sources. Proceedings of the 2001 International Database Engineering and Applications Symposium (2001), IEEE Computer Society, Washington, DC 209-218
32. Madnick S.E., Wang Y.R., and Xian X. The design and implementation of a corporate householding knowledge processor to improve data quality. Journal of Management Information Systems 20 3 (2003) 41-69
33. McCallum A., and Wellner B. Conditional models of identity uncertainty with application to noun coreference. Advances in Neural Information Processing Systems 17 (2005) 905-912
34. Métais E. Enhancing information systems management with natural language processing techniques. Data & Knowledge Engineering 41 2-3 (2002) 247-272
35. A.E. Monge, C.P. Elkan, The filed matching problem: algorithms and applications, in: Proceedings of the second International Conference on Knowledge Discovery and Data Mining, 1996, pp. 267-270.
36. Murthy S.K. Automatic construction of decision trees from data: a multi-disciplinary survey. Data Mining and Knowledge Discovery 2 4 (1998) 345-389
37. Newcombe H.B. Handbook of Record Linkage: Methods for Health and Statistical Studies Administration and Business (1988), Oxford University Press
38. Newcombe H.B., Kennedy J.M., Axford S.J., and James A.P. Automatic linkage of vital records. Science 130 3381 (1959) 954-959
39. J.C. Pinheiro, D.X. Sun, Methods for linking and mining massive heterogeneous databases, in: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, 1998, pp. 309-313.
40. Pluempitiwiriyawej C., and Hammer J. Element matching across data-oriented XML sources using a multi-strategy clustering model. Data & Knowledge Engineering 48 3 (2004) 297-333
41. Quinlan J.R. Discovering rules by induction from large collections of examples. In: Michie D. (Ed). Expert Systems in the Micro-electronic Age (1979), Edinburgh University Press, Edinburgh 168-201
42. Quinlan J.R. C.45: Programs for Machine Learning (1993), Morgan Kaufman
43. Saggion H., Cunningham H., Bontcheva K., Maynard D., Hamza O., and Wilks Y. Multimedia indexing through multi-source and multi-language information extraction: the MUMIS project. Data & Knowledge Engineering 48 2 (2004) 247-264
44. S. Sarawagi, A. Bhamidipaty, Interactive deduplication using active learning, in: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Edmonton, Alberta, 2002.
45. Segev A., and Chatterjee A. A framework for object matching in federated databases and its implementation. International Journal of Cooperative Information Systems 5 1 (1996) 73-99
46. Seligman L., Rosenthal A., Lehner P., and Smith A. Data integration: where does the time go?. IEEE Data Engineering Bulletin 25 3 (2002) 3-10
47. Shapiro A.D. Structured Induction in Expert Systems (1987), Addison-Wesley, Wokingham, UK
48. Stephen G.A. String Searching Algorithms (1994), World Scientific Publishing Co. Pte. Ltd., River Edge, NJ
49. Strong D.M., Lee Y.W., and Wang R.W. Data quality in context. Communications of the ACM 40 5 (1997) 103-110
50. Tejada S., Knoblock C.A., and Minton S. Learning object identification rules for information integration. Information Systems 26 8 (2001) 607-633
51. Torvik V., Weeber M., Swanson D.R., and Smalheiser N.R. A probabilistic similarity metric for Medline records: a model for author name disambiguation. Journal of the American Society for Information Science and Technology 56 2 (2005) 140-258
52. A.C. Trembly, Poor data quality: A $600 billion issue, National Underwriter Property & Casualty - Risk & Benefits Management, March 18, 2002 Edition.
53. Utgoff P.E. Shift of Bias for Inductive Concept Learning. In: Michalski R., Carbonell J., and Mitchell T. (Eds). Machine Learning: An Artificial Intelligence Approach, Vol. II (1986), Morgan Kaufmann, Los Altos, CA 107-148 (Chapter 5)
54. Verykios V.S., Elmagarmid A.K., and Houstis E.N. Automating the approximate record-matching process. Information Science 126 1-4 (2000) 83-98
55. Weiss S.M., and Kulikowski C.A. Computer Systems That Learn - Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert System (1991), Morgan Kaufmann
56. W.E. Winkler, Matching and record linkage, in: Proceedings of Record Linkage Techniques - 1997, 1997, pp. 374-403.
57. W.E. Winkler, Record linkage software and methods for merging administrative lists, Exchange of Technology and Know-How, Luxembourg, 1999, pp. 313-323.
58. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. second ed. (2005), Morgan Kaufmann
59. Wolpert D.H. Stacked generalization. Neural Networks 5 2 (1992) 241-259
60. Wolpert D.H. The relationship between PAC, the statistical physics framework, the Bayesian framework, and the VC framework. Proceedings of the SFI/CNLS Workshop on Formal Approaches to Supervised Learning (1994), Addison-Wesley 117-214
61. W. Wu, C. Yu, A. Doan, W. Meng, An interactive clustering-based approach to integrating source query interfaces on the deep Web, in: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, 2004, pp. 95-106.
62. Zhao H. Semantic matching across heterogeneous data sources. Communications of the ACM 50 1 (2007) 45-50
63. Zhao H., and Ram S. Constrained cascade generalization of decision trees. IEEE Transactions on Knowledge and Data Engineering 16 6 (2004) 727-739
64. Zhao H., and Ram S. Entity identification for heterogeneous database integration - a multiple classifier system approach and empirical evaluation. Information Systems 30 2 (2005) 119-132
65. Zhao H., and Sinha A.P. An efficient algorithm for generating generalized decision forests. IEEE Transactions on Systems Man and Cybernetics Part A 35 5 (2005) 754-762
66. Zhao H., and Ram S. Combining schema and instance information for integrating heterogeneous data sources. Data & Knowledge Engineering 61 2 (2007) 281-303