Missing values in deduplication of electronic: Patient data

Journal of the American Medical Informatics Association

Volumn 19, Issue E1, 2012, Pages

  Sariyar, M ^a   Borg, A ^a   Pommerening, K ^a  

^a UNIVERSITY MEDICAL CENTER MAINZ   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL PARAMETERS; ARTICLE; CANCER REGISTRY; COMPARATIVE STUDY; DATA ANALYSIS; ELECTRONIC MEDICAL RECORD; HUMAN; SCORING SYSTEM;

ELECTRONIC HEALTH RECORDS; HUMANS; MEDICAL RECORD LINKAGE; NEOPLASMS; REGISTRIES;

EID: 84863544276     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2011-000461     Document Type: Article

References (42)

1. Elmagarmid AK, Ipeirotis PG, Verykios VS. Duplicate record detection: a survey. IEEE Trans Knowl Data Eng 2007;19:1-16.
2. Parkin DM, Bray F. Evaluation of data quality in the cancer registry: principles and methods. Part II. Completeness. Eur J Cancer 2009;45:756-64.
3. Schouten LJ, de Rijke JM, Schlangen JT, et al. Evaluation of the effect of breast cancer screening by record linkage with the cancer registry, the Netherlands. J Med Screen 1998;5:37-41.
4. Christen P, Goiser K. Quality and complexity measures for data linkage and deduplication. In: Guillet F, Hamilton H, eds. Quality Measures in Data Mining, 43rd edn. Heidelberg: Springer Berlin, 2007:127-51.
5. Fellegi IP, Sunter AB. A theory for record linkage. J Am Stat Assoc 1969;64:1183-210.
6. Christen P. Probabilistic data generation for deduplication and data linkage. Intelligent Data Engineering and Automated Learning Ideal 2005, Proceedings of the Sixth International Conference on Intelligent Data Engineering and Automated Learning (IDEAL'05), Brisbane, July 2005. Lecture notes in computer science, Springer, 2005;3578:109-16.
7. Hernandez MA, Stolfo SJ. Real-world data is dirty: data cleansing and the merge/ purge problem. Data Min Knowl Discov 1998;2:9-37.
8. Michalowski M, Thakkar S, Knoblock CA. Automatically utilizing secondary sources to align information across sources. Ai Magazine 2005;26:33-44.
9. Gardner J, Xiong L. An integrated framework for de-identifying unstructured medical data. Data Knowl Eng 2009;68:1441-51.
10. Gomatam S, Carter R, Ariet M, et al. An empirical comparison of record linkage procedures. Stat Med 2002;21:1485-96.
11. Jaro MA. Advances in record-linkage methodology as applied to matching the 1985 census of Tampa/Florida. J Am Stat Assoc 1989;89:414-20.
12. Noren GN, Orre R, Bate A, et al. Duplicate detection in adverse drug reaction surveillance. Data Min Knowl Discov 2007;14:305-28.
13. Roos LL Jr, Wajda A, Nicol JP. The art and science of record linkage: methods that work with few identifiers. Comput Biol Med 1986;16:45-57.
14. Herzog TN, Scheuren FJ, Winkler WE. Data Quality and Record Linkage Techniques. New York, NY: Springer, 2007.
15. Tromp M, Ravelli AC, Bonsel GJ, et al. Results from simulated data sets: probabilistic record linkage outperforms deterministic record linkage. J Clin Epidemiol 2011;64:565-72.
16. Winkler WE. Advanced methods for Record Linkage. Statistical Research Division U.S. Census Bureau, Suitland, Maryland, 1994. Technical Report. http://www.census.gov/srd/papers/pdf/rr94-5.pdf
17. Acock AC. Working with missing values. J Marriage Fam 2005;67:1012-28.
18. King G, Honaker J, Joseph A, et al. Analyzing incomplete political science data: an alternative algorithm for multiple imputation. Am Polit Sci Rev 2001;95: 49-69.
19. Christen P. A survey of indexing techniques for scalable record linkage and deduplication. IEEE Trans Knowl Data Eng 2011;99:196-214.
20. Little RJ, Rubin DB. Statistical Analysis with Missing Data. Hoboken, NJ: Wiley-Interscience, 2002.
21. Molenberghs G, Kenward MG. Missing Data in Clinical Studies. Chichester: Wiley, 2007.
22. Ding YF, Simonoff JS. An investigation of missing data methods for classification trees applied to binary response data. J Mach Learn Res 2010;11:131-70.
23. McGlincy MH. A B ayesian record linkage methodology for multiple imputation of missing links. ASA Proceedings of the Joint Statistical Meetings. Alexandria, VA, 7-10 August 2004:4001-8.
24. James F. Robison-Cox. A record linkage approach to imputation of missing data: analyzing tag retention in a tag: recapture experiment. J Agric Biol Environ Stat 1998;3:48-61.
25. Saar-Tsechansky M, Provost F. Handling missing values when applying classification models. J Mach Learn Res 2007;8:1625-57.
26. Salzberg SL. C4.5: Programs for machine learning by J. Ross Quinlan. Morgan Kaufmann Publishers, Inc., 1993. Mach Learn 1994;16:235-40.
27. Postel HJ. Die Kölner Phonetik. Ein Verfahren zur Identifizierung von Personennamen auf der Grundlage der Gestaltanalyse. IBM-Nachrichten 1969;19:925-31.
28. Yancey WE. Evaluating String Comparator Performance for Record Linkage. Suitland, Maryland: Statistical Research Division U.S. Census Bureau, 2005. Technical Report.
29. Sariyar M, Borg A, Pommerening K. Evaluation of record linkage methods for iterative insertions. Methods Inf Med 2009;48:429-37.
30. Cochinwala M, Kurien V, Lalk G, et al. Efficient data reconciliation. Inform Sci 2001;137:1-15.
31. Breiman L, Friedman J, Olshen R, et al. Classification and Regression Trees. Belmont, California: Wadsworth, 1984.
32. rpart: Recursive Partitioning. R package [computer program]. Version 3.1-47. 2010. http://cran.r-project.org/package1/4rpart
33. Verykios VS, Elmagarmid AK, Houstis EN. Automating the approximate recordmatching process. Inform Sci 2000;126:83-98.
34. Sarawagi S, Bhamidipaty A. Interactive deduplication using active learning. Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Edmonton, AB, Canada, July 23-25, 2002:269-78.
35. Tejada S, Knoblock CA, Minton S. Learning object identification rules for information integration. Information Systems 2001;26:607-33.
36. Sariyar M, Borg A. Record Linkage in R. R package [computer program]. Version 0.3-4. Mainz, Germany, 2011. http://cran.r-project.org/package=RecordLinkage
37. Sariyar M, Borg A. The RecordLinkage Package: Detecting Errors in Data. The R Journal 2010;2:61-7.
38. Therneau TM, Atkinson EJ. An Introduction to Recursive Partitioning Using the Rpart Routine. Rochester, Minnesota: Mayo Clinic, Section of Biostatistics, 1997. Technical Report No. 61.
39. Breiman L. Bagging predictors. Mach Learn 1996;24:123-40.
40. Freund Y, Schapire RE. Experiments with a new boosting algorithm. Machine Learning: Proceedings of the Thirteenth International Conference, Bari, Italy, 3-6 July 1996 1996:148-56.
41. Peters A, Hothorn T, Lausen B. ipred: Improved predictors. R News 2002;2:33-6.
42. Altman DG, Bland JM. Quartiles, quintiles, centiles, and other quantiles. BMJ 1994;309:996.