Optimal stopping: A record-linkage approach

Journal of Data and Information Quality

Volumn 1, Issue 2, 2009, Pages

  Moustakides, George V ^a   Verykios, Vassilios S ^b  

^a UNIVERSITY OF PATRAS   (Greece)

^b UNIVERSITY OF THESSALY   (Greece)

Author keywords

Duplicate detection; Optimal stopping; Record linkage

Indexed keywords

AVERAGE COST CRITERION; DECISION METHODOLOGY; DECISION PROCESS; DUPLICATE DETECTION; OPTIMAL STOPPING; OPTIMUM SOLUTION; REAL DATA SETS; REAL-WORLD ENTITIES; RECORD-LINKAGE;

DECISION TREES;

OPTIMIZATION;

EID: 78651589222     PISSN: 19361955     EISSN: 19361963     Source Type: Journal    
DOI: 10.1145/1577840.1577844     Document Type: Article

References (28)

1. ANANTHAKRISHNA, R., CHAUDHURI, S., AND GANTI, V. 2002. Eliminating fuzzy duplicates in data warehouses. In Proceedings of the 28th International Conference on Very Large Databases (VLDB'02)
2. BHATTACHARYA, I. AND GETOOR, L. 2005. Entity resolution in graph data. Tech. rep. CS-TR- 4758, Computer Science Department, University of Maryland
3. BILENKO, M., MOONEY, R. J., COHEN, W. W., RAVIKUMAR, P., AND FIENBERG, S. E. 2003. Adaptive name matching in information integration. IEEE Intell. Syst. 18, 5, 16-23
4. CHAUDHURI, S., GANJAM, K., GANTI, V., AND MOTWANI, R. 2003. Robust and efficient fuzzy match for online data cleaning. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). 313-324
5. COHEN, W. W. 2000. Data integration using similarity joins and a word-based information representation language. ACM Trans. Inform. Syst. 18, 3, 288-321
6. COHEN, W. W. AND RICHMAN, J. 2002. Learning to match and cluster large high-dimensional data sets for data integration. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'02)
7. DEMPSTER, A. P., LAIRD, N. M., AND RUBIN, D. B. 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Statist. Soc. B, 39, 1-38
8. ELMAGARMID, A. K., IPEIROTIS, P. G., AND VERYKIOS, V. S. 2007. Duplicate record detection: A survey. IEEE Trans. Knowl. Data Eng. 19, 1, 1-16
9. FELLEGI, I. P. AND SUNTER, A. B. 1969. A theory for record linkage. J. Amer. Statist. Assoc. 64, 328, 1183-1210
10. GALHARDAS, H., FLORESCU, D., SHASHA, D., SIMON, E., AND SAITA, C. A. 2001. Declarative data cleaning: Language, model, and algorithms. In Proceedings of the 27th International Conference on Very Large Databases (VLDB'01). 371-380
11. GUHA, S., KOUDAS, N., MARATHE, A., AND SRIVASTAVA, D. 2004. Merging the results of approximate match operations. In Proceedings of the 30th International Conference on Very Large Databases (VLDB'04). 636-647
12. HERN ́ANDEZ, M. A. AND STOLFO, S. J. 1995. The merge/purge problem for large databases. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'95). 127-138
13. JOACHIMS, T. 1999. Making large-scale SVM learning practical. In Advances in Kernel Methods - Support Vector Learning, B. Schölkopf, Eds. MIT Press
14. MCCALLUM, A. AND WELLNER, B. 2004. Conditional models of identity uncertainty with application to noun coreference. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS'04)
15. MONGE, A. E. AND ELKAN, C. P. 1996. The field matching problem: Algorithms and applications. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD'96). 267-270
16. NEWCOMBE, H. B. AND KENNEDY, J. M. 1962. Record linkage: Making maximum use of the discriminating power of identifying information. Comm. ACM 5, 11, 563-566
17. NEWCOMBE, H. B., KENNEDY, J. M., AXFORD, S., AND JAMES, A. 1959. Automatic linkage of vital records. Sci. 130, 3381, 954-959
18. RAVIKUMAR, P. AND COHEN, W. W. 2004. A hierarchical graphical model for record linkage. In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence (UAI'04)
19. SARAWAGI, S. AND BHAMIDIPATY, A. 2002. Interactive deduplication using active learning. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'02). 269-278
20. SHIRYAYEV, A. 1978. Optimal Stopping Rules. Springer
21. SINGLA, P. AND DOMINGOS, P. 2004. Multi-Relational record linkage. In Proceedings of the ACM SIKKDD International Conference on Knowledge Discovery 2nd Data Mining (KDD'04): Workshop on Multi-Relational Data Mining. 31-48
22. TEJADA, S., KNOBLOCK, C. A., AND MINTON, S. 2002. Learning domain-independent string transformation weights for high accuracy object identification. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'02)
23. TEPPING, B. J. 1968. A model for optimum linkage of records. J. Amer. Statist. Assoc. 63, 324, 1321-1332
24. VERYKIOS, V. S. AND MOUSTAKIDES, G. V. 2004. A generalized cost optimal decision model for record matching. In Proceedings of the International Workshop on Information Quality in Information Systems. 20-26
25. VERYKIOS, V. S.,MOUSTAKIDES, G. V., AND ELFEKY, M. G. 2003. A bayesian decision model for cost optimal record matching. VLDB J. 12, 1, 28-40
26. WINKLER, W. E. 1993. Improved decision rules in the felligi-sunter model of record linkage. Tech. rep., Statistical Research Report Series RR93/12, U.S. Bureau of the Census, Washington, D.C
27. WINKLER,W. E. 1995. Matching and record linkage. In Business Survey Methods. Wiley, 355-384
28. YANCEY, W. E. AND WINKLER, W. E. 2002. Record linkage software. User documentation. Tech. rep., Statistical Research Report Series, U.S. Bureau of the Census, Washington, D.C