A benchmark comparison of deterministic and probabilistic methods for defining manual review datasets in duplicate records reconciliation

Journal of the American Medical Informatics Association

Volumn 21, Issue 1, 2014, Pages 97-104

  Joffe, Erel ^a   Byrne, Michael J ^a   Reeder, Phillip ^a   Herskovic, Jorge R ^a,b   Johnson, Craig W ^a   McCoy, Allison B ^a   Sittig, Dean F ^a   Bernstam, Elmer V ^a,c  

^a UNIVERSITY OF TEXAS   (United States)

^b UNIVERSITY OF TEXAS MD ANDERSON CANCER CENTER   (United States)

^c UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; FUZZY SYSTEM; INTERMETHOD COMPARISON; MEDICAL RECORD; PREDICTIVE VALUE; PROBABILITY; TRAINING;

MEDICAL RECORD LINKAGE [N04.452.859.564.550]; MEDICAL RECORDS SYSTEMS, COMPUTERIZED [L01.700.508.300.695];

ALGORITHMS; BENCHMARKING; ELECTRONIC HEALTH RECORDS; FUZZY LOGIC; HUMANS; MEDICAL RECORD LINKAGE; PROBABILITY;

EID: 84890495194     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2013-001744     Document Type: Article

References (33)

1. Wiedemann LA. Fundamentals for Building a Master Patient Index/Enterprise Master Patient Index (Updated). http://library.ahima.org/xpedio/groups/public/documents/ ahima/bok1_048389.hcsp?dDocName=bok1_048389.
2. Joffe E, Bearden CF, Byrne MJ, et al. Duplicate patient records-implication for missed laboratory results. Proceedings of the AMIA Annual Symposium, 2012:1269-75.
3. McCoy AB, Wright A, Kahn MG, et al. Matching identifiers in electronic health records: implications for duplicate records and patient safety. BMJ Qual Saf 2013;22:219-24.
4. Elmagarmid AK, Member S. Duplicate record detection: a survey. IEEE Trans Knowledge Data Eng 2007;19:1-16.
5. Christen P, Goiser K. Quality and complexity measures for data linkage and deduplication. In: Guillet FJ, Hamilton HJ, eds. Quality measures in data mining. Berlin: Springer, 2007:127-51.
6. Winkler WE. Overview of record linkage and current research directions. Washington, DC: Statistical Research Division of the U.S. Census Bureau, 2006.
7. Verykios VS, Moustakides GV, Elfeky MG. A Bayesian decision model for cost optimal record matching. Int J Very Large Data Bases 2003;12:28-40.
8. Studdert DM, Mello MM, Gawande AA, et al. Claims, errors, and compensation payments in medical malpractice litigation. N Engl J Med 2006;354:2024-33.
9. Köpcke H, Thor A, Rahm E. Evaluation of entity resolution approaches on real-world match problems. Proceedings of the VLDB Endowment, 2010:484-93.
10. Zhu VJ, Overhage MJ, Egg J, et al. An empiric modification to the probabilistic record linkage algorithm using frequency-based weight scaling. J Am Med Inform Assoc 2000;16:738-45.
11. Sariyar M, Borg A, Pommerening K. Missing values in deduplication of electronic patient data. J Am Med Inform Assoc 2012;19:e76-82.
12. Sarawagi S, Breiman L, Friedman JH, et al. Interactive deduplication using active learning. Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2002:269-78.
13. Grannis SJ, Overhage JM, McDonald CJ. Analysis of identifier performance using a deterministic linkage algorithm. Proceedings of the AMIA Annual Symposium, 2002:305-9.
14. Salkowitz SM, Clyde S. The unique records portfolio. Decatur, GA: Public Health Informatics Institute, 2006.
15. Christen P. Data matching. Berlin: Springer-Verlag, 2012.
16. Campbell KM, Deck D, Krupski A. Record linkage software in the public domain: a comparison of Link Plus, the Link King, and a "basic" deterministic algorithm. Health Inform J 2008;14:5-15.
17. Shahri H, Barforush A. A flexible fuzzy expert system for fuzzy duplicate elimination in data cleaning. In: Galindo F, Takizawa M, Traunmaller R, eds. Database and expert systems applications. Berlin: Springer-Verlag, 2004:161-70.
18. Jaro MA. Advances in record-linkage methodology as applied to matching the 1985 Census of Tampa, Florida. J Am Stat Association 1989;84:414-20.
19. Grannis SJ, Overhage JM, Hui S, et al. Analysis of a probabilistic record linkage technique without human review. Proceedings of the AMIA Annual Symposium, 2003:259-63.
20. Do C, Batzoglou S. What is the expectation maximization algorithm? Nat Biotechnol 2008;26:897-9.
21. Elfeky MG, Verykios VS, Elmagarmid AK. TAILOR: a record linkage toolbox. Proceedings 18th International Conference on Data Engineering, IEEE Comput. Soc, 17-28.
22. De Carvalho MG, Laender AHF, Goncalves MA, et al. A genetic programming approach to record deduplication. IEEE Trans Knowledge and Data Eng 2012;24:399-412.
23. Eberhart R, Kennedy J. A new optimizer using particle swarm theory. Proceedings of the Sixth International Symposium on Micro Machine and Human Science, 1995:39-43.
24. Duvall SL, Fraser AM, Rowe K, et al. Evaluation of record linkage between a large healthcare provider and the Utah Population Database. J Am Med Inform Assoc 2012;19:e54-9.
25. Miller PL, Frawley SJ, Sayward FG. Exploring the utility of demographic data and vaccination history data in the deduplication of immunization registry patient records. J Biomed Inform 2001;34:37-50.
26. Duvall SL, Fraser AM, Kerber RA, et al. The impact of a growing minority population on identification of duplicate records in an enterprise data warehouse. Stud Health Technol Inform 2010;160:1122-6.
27. DuVall SL, Kerber RA, Thomas A. Extending the Fellegi-Sunter probabilistic record linkage method for approximate field comparators. J Biomed Inform 2010;43:24-30.
28. Sariyar M, Borg A, Pommerening K. Active learning strategies for the deduplication of electronic patient data using classification trees. J Biomed Inform 2012;45:893-900.
29. Gomatam S, Carter R, Ariet M, et al. An empirical comparison of record linkage procedures. Stat Med 2002;21:1485-96.
30. Li B, Quan H, Fong A, et al. Assessing record linkage between health care and Vital Statistics databases using deterministic methods. BMC Health Serv Res 2006;6:1-10.
31. Gu L, Baxter R. Decision models for record linkage. In: Williams GJ, Simoff SJ, eds. Data mining. Berlin: Springer, 2006:146-60.
32. Ho VH, Compton P, Benatallah B, et al. An incremental knowledge acquisition method for improving duplicate invoices detection. IEEE 25th International Conference on Data Engineering. IEEE, 2009:1415-18.
33. User Manual for the De-duplication Evaluation Toolkit. Center for Disease Control and Prevention, 2002.