Combining schema and instance information for integrating heterogeneous data sources

Data and Knowledge Engineering

Volumn 61, Issue 2, 2007, Pages 281-303

  Zhao, Huimin ^a   Ram, Sudha ^b  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Data integration; Heterogeneous databases; Semantic correspondence

Indexed keywords

CLASSIFICATION (OF INFORMATION); CLUSTER ANALYSIS; DATABASE SYSTEMS; INFORMATION RETRIEVAL; ITERATIVE METHODS; SEMANTICS;

DATA INTEGRATION; DATA SOURCES; HETEROGENEOUS DATABASES; SEMANTIC CORRESPONDENCE;

KNOWLEDGE ACQUISITION;

EID: 33947161876     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2006.06.004     Document Type: Article

References (54)

1. Afifi A.A., and Clark V. Computer-Aided Multivariate Analysis. third ed. (1996), Chapman & Hall
2. Ambrosio A.P., Métais E., and Meunier J. The linguistic level: contribution for conceptual design, view integration, reuse and documentation. Data & Knowledge Engineering 21 2 (1997) 111-129
3. Bell G.B., and Sethi A. Matching records in a national medical patient index. Communications of the ACM 44 8 (2001) 83-88
4. S.S. Benkley, J.F. Fandozzi, E.M. Housman, G.M. Woodhouse, Data element tool-based analysis (DELTA), The MITRE Corporation, Bedford, MA, Technical Report, MTR 95B0000147, 1995.
5. Bright M.W., Hurson A.R., and Pakzad S.H. Automated resolution of semantic heterogeneity in multidatabases. ACM Transactions on Database Systems 19 2 (1994) 212-253
6. C.D. Budzinsky, Automated spelling correction, Statistics Canada, Unpublished Report, 1991.
7. Chen A.L.P., Tsai P.S.M., and Koh J.L. Identifying object isomerism in multidatabase systems. Distributed and Parallel Databases 4 2 (1996) 143-168
8. C. Clifton, E. Housman, A. Rosenthal, Experience with a combined approach to attribute-matching across heterogeneous databases, in: Data Mining and Reverse Engineering, Proceedings of DS-7, 1997, pp. 429-451.
9. Costa J.A.F., and de Andrade Netto M.L. Estimating the number of clusters in multivariate data by self-organizing maps. International Journal of Neural Systems 9 3 (1999) 195-202
10. Dey D., Sarkar S., and De P. A probabilistic decision model for entity matching in heterogeneous databases. Management Science 44 10 (1998) 1379-1395
11. E. Ellmer, C. Huemer, D. Merkl, G. Pernul, Automatic classification of semantic concepts in view specifications, in: Database and Expert Systems Applications, Proceedings of 7th International Conference, DEXA '96, 1996, pp. 824-833.
12. Everitt B.S., Landau S., and Leese M. Cluster Analysis. fourth ed. (2001), Arnold, London
13. M.E. Fair, Record linkage in an information age society, in: Record Linkage Techniques-1997, 1997, pp. 427-441.
14. Fan W., Lu H., Madnick S.E., and Cheung D. Discovering and reconciling value conflicts for numerical data integration. Information Systems 26 (2001) 635-656
15. Fellegi I.P., and Sunter A.B. A theory of record linkage. Journal of the American Statistical Association 64 328 (1969) 1183-1210
16. M. Ganesh, J. Srivastava, T. Richardson, Mining entity-identification rules for database integration, in: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), 1996, pp. 291-294.
17. I.J. Haimowitz, Ö. Gür-Ali, H. Schwarz, Integrating and mining distributed customer databases, in: Proceedings of KDD-97, 1997, pp. 179-182.
18. S. Hayne, S. Ram, Multi-user view integration system (MUVIS): an expert system for view integration, in: Proceedings of the Sixth International Conference on Data Engineering, 1990, pp. 402-410.
19. Hernández M.A., and Stolfo S.J. Real-world data is dirty: data cleansing and the merge/purge problem. Data Mining and Knowledge Discovery 2 1 (1998) 9-37
20. Johannesson P. Supporting schema integration by linguistic instruments. Data & Knowledge Engineering 21 2 (1997) 165-182
21. Kirk R.E. Statistics: An Introduction. fourth ed. (1999), Harcourt Brace College Publishers
22. Kohonen T. Self-Organizing Maps (1995), Springer, Berlin
23. Li W.S., and Clifton C. SEMINT: a tool for identifying attribute correspondences in heterogeneous databases using neural networks. Data & Knowledge Engineering 33 1 (2000) 49-84
24. Lim T.S., Loh W.Y., and Shih Y.S. A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Machine Learning Journal 40 (1998) 203-228
25. H. Lu, W. Fan, C.H. Goh, S.E. Madnick, D.W. Cheng, Discovering and reconciling semantic conflicts: a data mining perspective, in: Data Mining and Reverse Engineering, Proceedings of DS-7, 1997, pp. 410-427.
26. S. Luján-Mora, M. Palomar, Reducing inconsistency in integrating data from different sources, in: Proceedings of the 2001 International Database Engineering and Applications Symposium, 2001, pp. 209-218.
27. J. Madhavan, P.A. Bernstein, E. Rahm, Generic schema matching with cupid, in: Proceedings of the 27th International Conferences on Very Large Databases, 2001, pp. 49-58.
28. Mangiameli P., Chen S.K., and West D. A comparison of SOM neural network and hierarchical clustering methods. European Journal of Operational Research 93 2 (1996) 402-417
29. N. Masood, B. Eaglestone, Semantics based schema analysis, in: Database and Expert Systems Applications, 9th International Conference (DEXA'98), 1998, pp. 80-89.
30. Mirbel I. Semantic integration of conceptual schemas. Data & Knowledge Engineering 21 2 (1997) 183-195
31. S. Navathe, H. Thomas, M. Satitsamitpong, A. Datta, A model to support E-catalog integration, in: Semantic Issues in e-Commerce Systems, Proceedings of DS-9, 2001, pp. 247-261.
32. Palopoli L., Pontieri L., Terracina G., and Ursino D. Intensional and extensional integration and abstraction of heterogeneous databases. Data & Knowledge Engineering 35 3 (2000) 201-237
33. Petersohn H. Assessment of cluster analysis and self-organizing maps. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 6 2 (1998) 136-149
34. J.C. Pinheiro, D.X. Sun, Methods for linking and mining massive heterogeneous databases, in: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, 1998, pp. 309-313.
35. Quinlan J.R. C4.5: Programs for Machine Learning (1993), Morgan Kaufman, San Mateo, CA
36. Ram S., and Venkataraman R. Schema integration: past, present and future. In: Elmagarmid A., Rusinkiewicz M., and Sheth A. (Eds). Management of Heterogeneous and Autonomous Database Systems (1999), Morgan Kaufman Publishers 119-156
37. S. Ram, H. Zhao, Detecting both schema-level and instance-level correspondences for the integration of E-catalogs, in: Proceedings of the Eleventh Annual Workshop on Information Technology and Systems (WITS'01), New Orleans, Louisiana, USA, 2001, pp. 193-198.
38. M.A. Rodríguez, M.J. Egenhofer, R.D. Rugg, Assessing semantic similarities among geospatial feature class definitions, in: Proceedings of the Second International Conference on Interoperating Geographic Information Systems (INTEROP'99), Lecture Notes in Computer Science, vol. 1580, 1999, pp. 189-202.
39. Segev A., and Chatterjee A. A framework for object matching in federated databases and its implementation. International Journal of Cooperative Information Systems 5 1 (1996) 73-99
40. A. Si, C.C. Ying, D. McLeod, On using historical update information for instance identification in federated databases, in: Proceedings of the First IFCIS International Conference on Cooperative Information Systems, 1996, pp. 68-77.
41. Song W.W., Johannesson P., and Bubenko J.A. Semantic similarity relations and computation in schema integration. Data & Knowledge Engineering 19 1 (1996) 65-97
42. Srinivasan U., Ngu A.H.H., and Gedeon T. Managing heterogeneous information systems through discovery and retrieval of generic concepts. Journal of the American Society for Information Science 51 8 (2000) 707-723
43. Stephen G.A. String Searching Algorithms (1994), World Scientific Publishing Co. Pte. Ltd.
44. Tejada S., Knoblock C.A., and Minton S. Learning object identification rules for information integration. Information Systems 26 8 (2001) 607-633
45. Verykios V.S., Elmagarmid A.K., and Houstis E.N. Automating the approximate record-matching process. Information Sciences 126 1-4 (2000) 83-98
46. Weiss S.M., and Kulikowski C.A. Computer Systems That Learn-Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert System (1991), Morgan Kaufman Publishers, Inc.
47. W.E. Winkler, Matching and record linkage, in: Record Linkage Techniques-1997, 1997, pp. 374-403.
48. Winkler W.E. Record linkage software and methods for merging administrative lists. Exchange of Technology and Know-How (1999), Eurostat, Luxembourg 313-323
49. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. second ed. (2005), Morgan Kaufman Publishers, San Francisco, California
50. Wolpert D.H. The relationship between PAC, the statistical physics framework, the Bayesian framework, and the VC framework. In: Wolpert D.H. (Ed). The Mathematics of Generalization-Proceedings of the SFI/CNLS Workshop on Formal Approaches to Supervised Learning (1994), Addison-Wesley 117-214
51. H. Zhao, Combining schema and instance information for integrating heterogeneous databases: an analytical approach and empirical evaluation, Ph.D. dissertation, University of Arizona, 2002.
52. Zhao H., and Ram S. Clustering schema elements for semantic integration of heterogeneous data sources. Journal of Database Management 15 4 (2004) 88-106
53. Zhao H., and Ram S. Entity identification for heterogeneous database integration-a multiple classifier system approach and empirical evaluation. Information Systems 30 2 (2005) 119-132
54. Zhao H., and Ram S. Clustering similar schema elements across heterogeneous databases: a first step in database integration. In: Siau K. (Ed). Advanced Topics in Database Research vol. 5 (2006), Idea Group Publishing 235-256