Matching attributes across overlapping heterogeneous data sources using mutual information

Journal of Database Management

Volumn 21, Issue 4, 2010, Pages 91-110

  Zhao, Huimin ^a  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

Author keywords

Attribute Correspondence; Attribute Matching; Heterogeneous Databases; Information Theory; Mutual Information

Indexed keywords

ATTRIBUTE CORRESPONDENCE; ATTRIBUTE MATCHING; DATA SOURCE; ENCOUNTERED TYPE; HETEROGENEOUS DATA SOURCES; HETEROGENEOUS DATABASE; MATCHING TOOLS; MUTUAL INFORMATIONS;

INFORMATION THEORY;

EID: 79953089746     PISSN: 10638016     EISSN: 15338010     Source Type: Journal    
DOI: 10.4018/jdm.2010100105     Document Type: Article

References (53)

1. Baeza-Yates, R., & Ribeiro-Neto, B. (1999). Modern Information Retrieval. Reading, MA: Addison- Wesley.
2. Beirlant, J., Dudewicz, E. J., Gyorfi, L., & van der Meulen, E. C. (1997). Non-parametric entropy estimation: An overview. International Journal of Mathematical and Statistical Sciences, 6(1), 17-39.
3. Benkley, S. S., Fandozzi, J. F., Housman, E. M., & Woodhouse, G. M. (1995). Data Element Tool-based Analysis (DELTA) (Tech. Rep. MTR 95B0000147). Bedford, MA: The MITRE Corporation.
4. Bernstein, P. A., Melnik, S., & Churchill, J. E. (2006). Incremental schema matching. In Proceedings of the 32nd International Conference on Very Large Data Bases (pp. 1167-1170).
5. Bilke, A., & Naumann, F. (2005). Schema Matching Using Duplicates. In Proceedings of the 21st International Conference on Data Engineering (pp. 69-80). (Pubitemid 41731116)
6. Bonifati, A., Mecca, G., Pappalardo, A., Raunich, S., & Summa, G. (2008). Schema mapping verification: The spicy way. In Proceedings of the 11th International Conference on Extending Database Technology: Advances in Database Technology (pp. 85-96). (Pubitemid 351661694)
7. Bozovic, N., & Vassalos, V. (2008). Two-phase schema matching in real world relational databases. In Proceedings of the ICDE Workshop on Information Integration Methods (pp. 290-296).
8. Bright, M. W., Hurson, A. R., & Pakzad, S. H. (1994). Automated resolution of semantic heterogeneity in multidatabases. ACM Transactions on Database Systems, 19(2), 212-253. doi:10.1145/176567.176569
9. Choi, N., Song, I.-Y., & Han, H. (2006). A survey on ontology mapping. SIGMOD Record, 35(3), 34-41. doi:10.1145/1168092.1168097 (Pubitemid 44547581)
10. Chua, C. E. H., Chiang, R. H. L., & Lim, E.-P. (2003). Instance-based attribute identification in database integration. The VLDB Journal, 12(3), 228-243. doi:10.1007/s00778-003-0088-y (Pubitemid 37334445)
11. Clifton, C., Housman, E., & Rosenthal, A. (1997). Experience with a combined approach to attributematching across heterogeneous databases. In Proceedings of the IFIP Working Conference on Data Semantics (DS-7) (pp. 429-451).
12. Cohen, W. W. (2000). Data integration using similarity joins and a word-based information representation language. ACM Transactions on Information Systems, 18(3), 288-321. doi:10.1145/352595.352598
13. Darbellay, G. A. (1999). An estimator of the mutual information based on a criterion for independence. Computational Statistics & Data Analysis, 32(1), 1-17. doi:10.1016/S0167-9473(99)00020-1 (Pubitemid 30542669)
14. Dhamanka, R., Lee, Y., Doan, A., Halevy, A., & Domingos, P. (2004). iMAP: Discovering complex semantic matches between database schemas. In Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data (pp. 383-394).
15. Do, H.-H., Melnik, S., & Rahm, E. (2003). Comparison of schema matching evaluations. In Proceedings of the 2nd International Workshop on Web Databases (pp. 221-237).
16. Do, H.-H., & Rahm, E. (2007). Matching large schemas: Approaches and evaluation. Information Systems, 32(6), 857-885. doi:10.1016/j.is.2006.09.002 (Pubitemid 46670603)
17. Doan, A., & Halevy, A. (2005). Semantic-integration research in the database community: A Brief Survey. AI Magazine, 26(1), 83-94. (Pubitemid 40527390)
18. Domshlak, C., Gal, A., & Roitman, H. (2007). Rank aggregation for automatic schema matching. IEEE Transactions on Knowledge and Data Engineering, 19(4), 538-553. doi:10.1109/TKDE.2007.1010
19. Drum, C., Schmitt, M., Do, H.-H., & Rahm, E. (2007). QuickMig - automatic schema matching for data migration projects. In Proceedings of the 16th Conference on Information and Knowledge Management (CIKM2007) (pp. 107-116).
20. Fan, W., Lu, H., Madnick, S. E., & Cheung, D. W. (2001). Discovering and reconciling value conflicts for numerical data integration. Information Systems, 26(8), 635-656. doi:10.1016/S0306-4379(01)00043- 6 (Pubitemid 33046274)
21. Fan, W., Lu, H., Madnick, S. E., & Cheung, D. W. (2002). DIRECT: A system for mining data value conversion rules from disparate sources. Decision Support Systems, 34(1), 19-39. doi:10.1016/S0167- 9236(02)00006-4
22. Gal, A. (2006). Why is schema matching tough and what can we do about it? SIGMOD Record, 35(4), 2-5. doi:10.1145/1228268.1228269
23. Giunchiglia, F., Yatskevich, M., & Shvaiko, P. (2007). Semantic Matching: Algorithms and Implementation. Journal on Data Semantics, 9, 1-38.
24. Hall, P., & Morton, S. C. (1993). On the estimation of entropy. Annals of Institute of Mathematical Statistics, 45(1), 69-88. doi:10.1007/BF00773669
25. He, B., & Chang, K. C.-C. (2006). Automatic complex schema matching across web query interfaces: A correlation mining approach. ACM Transactions on Database Systems, 31(1), 346-395. doi:10.1145/1132863.1132872
26. Hu, W., Qu, Y., & Cheng, G. (2008). Matching large ontologies: A divide-and-conquer approach. Data & Knowledge Engineering, 67(1), 140-160. doi:10.1016/j.datak.2008.06.003
27. Johannesson, P. (1997). Supporting schema integration by linguistic instruments. Data & Knowledge Engineering, 21(2), 165-182. doi:10.1016/S0169- 023X(96)00031-6 (Pubitemid 127423630)
28. Kang, J., & Naughton, J. F. (2003). On schema matching with opaque column names and data values. In Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data (pp. 205-216).
29. Kang, J., & Naughton, J. F. (2008). Schema matching using interattribute dependencies. IEEE Transactions on Knowledge and Data Engineering, 20(10), 1393-1407. doi:10.1109/TKDE.2008.100
30. Lee, Y., Sayyadian, M., Doan, A., & Rosenthal, A. S. (2007). eTuner: Tuning schema matching software using synthetic scenarios. The VLDB Journal, 16(1), 97-122. doi:10.1007/s00778-006-0024-z (Pubitemid 44655854)
31. Li, W. S., & Clifton, C. (2000). SEMINT: A tool for identifying attribute correspondences in heterogeneous databases using neural networks. Data & Knowledge Engineering, 33(1), 49-84. doi:10.1016/ S0169-023X(99)00044-0 (Pubitemid 30568312)
32. Lu, H., Fan, W., Goh, C. H., Madnick, S. E., & Cheng, D. W. (1997). Discovering and reconciling semantic conflicts: A data mining perspective. In Proceedings of the IFIP Working Conference on Data Semantics (DS-7) (pp. 410-427).
33. Madhavan, J., Bernstein, P., Doan, A., & Halevy, A. (2005). Corpus-based schema matching. In Proceedings of the 18th International Conference on Data Engineering (pp. 57-68). (Pubitemid 41731115)
34. March, S. T., Hevner, A., & Ram, S. (2000). Research commentary: An agenda for information technology research in heterogeneous and distributed environments. Information Systems Research, 11(4), 327-341. doi:10.1287/isre.11. 4.327.11873 (Pubitemid 33224534)
35. Nottelmanna, H., & Straccia, U. (2007). Information retrieval and machine learning for probabilistic schema matching. Information Processing & Management, 43(3), 552-576. doi:10.1016/j. ipm.2006.10.014 (Pubitemid 46149970)
36. Palopoli, L., Pontieri, L., Terracina, G., & Ursino, D. (2000). Intensional and extensional integration and abstraction of heterogeneous databases. Data & Knowledge Engineering, 35(3), 201-237. doi:10.1016/S0169-023X(00)00028-8
37. Pirrò, G., & Talia, D. (2008). LOM: A linguistic ontology matcher based on information retrieval. Journal of Information Science, 34(6), 845-860. doi:10.1177/0165551508091014
38. Rahm, E., & Bernstein, P. A. (2001). A survey of approaches to automatic schema matching. The VLDB Journal, 10(4), 334-350. doi:10.1007/ s007780100057 (Pubitemid 33570972)
39. Rull, G., Farré, C., Teniente, E., & Urpí, T. (2008). Validation of mappings between schemas. Data & Knowledge Engineering, 66(3), 414-437. doi:10.1016/j.datak.2008.04.009
40. Saleem, K., Bellahsene, Z., & Hunt, E. (2008). PORSCHE: Performance ORiented SCHEma mediation. Information Systems, 33(7-8), 637-657. doi:10.1016/j.is.2008.01.010
41. Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27, 379-423.
42. Shvaiko, P., & Euzenat, J. (2005). A survey of schema-based matching approaches. Journal of Data Semantics, 4, 146-171. (Pubitemid 350227701)
43. Soofi, E. S., & Retzer, J. J. (2002). Information indices: Unification and applications. Journal of Econometrics, 107(1-2), 17-40. doi:10.1016/S0304- 4076(01)00111-7
44. Stephen, G. A. (1994). String Searching Algorithms. Singapore: World Scientific Publishing Company.
45. Su, W., Wang, J., & Lochovsky, F. (2006). Holistic schema matching for web query interface. In Proceedings of the International Conference on Extending Database Technology (EDBT) (pp. 77-94). (Pubitemid 43986815)
46. Su, X., & Gulla, J. A. (2006). An information retrieval approach to ontology mapping. Data & Knowledge Engineering, 58(1), 47-69. doi:10.1016/j. datak.2005.05.012
47. Wang, J., Wen, J., Lockovsky, F., & Ma, W. (2004). Instance-based schema matching for web databases by domain-specific query probing. In Proceedings of the 30th International Conference on Very Large Data Bases (pp. 408-419).
48. Wu, W., Yu, C., Doan, A., & Meng, W. (2004). An interactive clustering-based approach to integrating source query interfaces on the deep web. In Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data (pp. 95-106).
49. Xu, L., & Embley, D. W. (2006). A composite approach to automating direct and indirect schema mappings. Information Systems, 31(8), 697-732. doi:10.1016/j.is.2005.01.003 (Pubitemid 44397262)
50. Zhao, H., & Ram, S. (2004). Clustering schema elements for semantic integration of heterogeneous data sources. Journal of Database Management, 15(4), 88-106.
51. Zhao, H., & Ram, S. (2007). Combining schema and instance information for integrating heterogeneous data sources. Data & Knowledge Engineering, 61(2), 281-303. doi:10.1016/j.datak.2006.06.004 (Pubitemid 46413396)
52. Zhao, H., & Ram, S. (2008). Entity matching across heterogeneous data sources: An approach based on constrained cascade generalization. Data & Knowledge Engineering, 66(3), 368-381. doi:10.1016/j. datak.2008.04.007
53. Zhao, H., & Soofi, E. S. (2006). Exploring attribute correspondences across heterogeneous databases by mutual information. Journal of Management Information Systems, 22(4), 305-336. doi:10.2753/ MIS0742-1222220411 (Pubitemid 44377679)