Record matching in data warehouses: A decision model for data consolidation

Operations Research

Volumn 51, Issue 2, 2003, Pages

  Dey, Debabrata ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Computers, databases: data warehousing, data consolidation; Information systems, decision support systems: record matching; Programming, integer: algorithms, heuristic systems

Indexed keywords

DATA CONSOLIDATION; HEURISTIC SYSTEMS; ONLINE ANALYTICAL PROCESSING;

CONSTRAINT THEORY; COSTS; DATABASE SYSTEMS; DECISION MAKING; DECISION SUPPORT SYSTEMS; DECISION THEORY; HEURISTIC PROGRAMMING; PROBLEM SOLVING; SOCIETIES AND INSTITUTIONS;

DATA WAREHOUSES;

EID: 4344686171     PISSN: 0030364X     EISSN: None     Source Type: Journal    
DOI: 10.1287/opre.51.2.240.12779     Document Type: Article

References (41)

1. Anahory, S., D. Murray. 1997. Data Warehousing in the Real World. Addison-Wesley, Reading, MA.
2. Batini, C., M. Lenzerini, S. B. Navathe. 1986. A comparative analysis of methodologies for database schema integration. ACM Comput. Surveys 18(4) 323-364.
3. Belin, T. R., D. B. Rubin. 1995. A method for calibrating false-match rates in record linkage. J. Amer. Statist. Assoc. 90(430) 694-707.
4. Bell, G. B., A. Sethi. 2001. Matching records in a national medical patient index. Comm. ACM 44(9) 83-88.
5. Berge, C. 1972. Balanced matrices. Math. Programming 2(1) 19-31.
6. _. 1989. Hypergraphs. North Holland, New York.
7. Bischoff, J., T. Alexander. 1997. Data Warehouse: Practical Advice from the Experts. Prentice Hall, Upper Saddle River, NJ.
8. Bright, M. W., A. R. Hurson, S. Pakzad. 1994. Automated resolution of semantic heterogeneity in multidatabases. ACM Trans. Database Systems 19(2) 212-253.
9. Chatterjee, A., A. Segev. 1995. Rule based joins in heterogeneous databases. Dec. Support Systems 13(1) 313-333.
10. Cheeseman, P., J. Kelly, M. Self, J. Stutz, W. Taylor, D. Friedman. 1988. Autoclass: A Bayesian classification system. Proc. Fifth Internat. Conf. on Machine Learning. Ann Arbor, MI, 54-64.
11. Copas, J. B., F. J. Hilton. 1990. Record linkage: Statistical models for matching computer records. J. Royal Statist. Soc. 153(3) 287-320.
12. Dayal, U., H.-Y. Hwang. 1984. View definition and generalization for database integration in a multidatabase system. IEEE Trans. Software Engrg. SE-10(6) 628-645.
13. Dey, D., S. Sarkar. 1996. A probabilistic relational model and algebra. ACM Trans. Database Systems 21(3) 339-369.
14. _, _. 2000. Modifications of uncertain data: A Bayesian framework for belief revision. Inform. Systems Res. 11(1) 1-16.
15. _, _, P. De. 1998. A probabilistic decision model for entity matching in heterogeneous databases. Management Sci. 44(10) 1379-1395.
16. Fang, D., J. Hammer, D. McLeod. 1991. The identification and resolution of semantic heterogeneity in multidatabase systems. Proc. First Internat. Workshop on Interoperability in Multidatabase Systems. Kyoto, Japan.
17. Fellegi, I. P., A. B. Sunter. 1969. A theory of record linkage. Amer. Statist. Assoc. J. 64 1183-1210.
18. Hernández, M. A., S. J. Stolfo. 1995. The merge/purge problem for large databases. Proc. 1995 ACM SIGMOD Conference. San Jose, CA, 127-138.
19. Hurwicz, M. 1997. Take your data to the cleaners. Byte 22(1) 97-102.
20. Inmon, W. H. 1996. Managing the data warehouse environment. Data Management Rev. 6(2) 8.
21. Jarke, M., M. Lenzerini, Y. Vassiliou, P. Vassiliadis. 2000. Fundamentals of Data Warehouse. Springer, New York.
22. Jaro, M. A. 1989. Advances in record-linkage methodology as applied to matching the 1985 census of Tampa, Florida. J. Amer. Statist. Assoc. 84(406) 414-420.
23. Kelley, R. P. 1984. Blocking considerations for record linkage under conditions of uncertainty. Proc. Section on Social Statistics. American Statistical Association, Alexandria, VA, 602-605.
24. Kim, W., I. Choi, S. Gala, M. Scheevel. 1993. On resolving semantic heterogeneity in multidatabase systems. Distributed and Parallel Databases 1(3) 251-279.
25. Kononenko, I., I. Bratco. 1991. Information-based evaluation criterion for classifier's performance. Machine Learning 6 67-80.
26. Kuhn, H. W. 1955. The Hungarian method for the assignment algorithm. Naval Res. Logist. Quart. 1(1-2) 83-97.
27. Larsen, M. D., D. B. Rubin. 2001. Iterative automated record linkage using mixture models. J. Amer. Statist. Assoc. 96(453) 32-41.
28. Larson, J. A., S. B. Navathe, R. Elmasri. 1989. A theory of attribute equivalence in databases with application to schema integration. IEEE Trans. Software Engrg. 15(4) 449-463.
29. Lawler, E. 1976. Combinatorial Optimization: Networks and Matroids. Holt, Rinehart, and Winston, New York.
30. Li, W.-S., C. Clifton. 1994. Semantic integration in heterogeneous databases using neural networks. Proc. 20th Internat. Conf. on Very Large Data Bases. Santiago, Chile, 1-12.
31. Lovász, L. 1972. Normal hypergraphs and perfect graph conjecture. Discrete Math. 2 253-267.
32. McCallum, A., K. Nigam, L. H. Ungar. 2000. Efficient clustering of high-dimensional data sets with application to reference matching. Proc. Sixth ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining. Boston, MA, 1-12.
33. Nigam, K., A. K. McCallum, S. Thrun, T. Mitchell. 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning 39(2/3) 103-134.
34. Papadimitriou, C. H., K. Steiglitz. 1982. Combinatorial Optimization: Algorithms and Complexity. Prentice Hall, Englewood Cliffs, NJ.
35. Rusinkiewicz, M., A. Sheth, G. Karabatis. 1991. Specifying inter-database dependencies in a multidatabase environment. IEEE Comput. 24(12) 46-53.
36. Schrijver, A. 1986. Theory of Linear and Integer Programming. Wiley, New York.
37. Tepping, B. J. 1968. A model for optimal linkage of records. J. Amer. Statist. Assoc. 63 1321-1332.
38. Ventrone, V., S. Heiler. 1991. Semantic heterogeneity as a result of domain evolution. ACM SIGMOD Record 20(4) 16-20.
39. Wang, Y. R., S. Madnick. 1989. The interdatabase instance identification problem in integrating autonomous systems. Proc. Fifth Internat. Conf. on Data Engrg. Los Angeles, CA, 46-55.
40. Winkler, W. E. 1985. Exact matching lists of businesses: Blocking, subfield identification, information theory. W. Alvey, B. Kliss, eds. Record Linkage Techniques 1985. U.S. Internal Revenue Service Publication 1299, 227-241.
41. _. 1994. Advanced methods for record linkage. Proc. Section on Survey Res. Methods. American Statistical Association, Alexandria, VA, 467-472.