Large-scale evaluation of automated clinical note de-identification and its impact on information extraction

Journal of the American Medical Informatics Association

Volumn 20, Issue 1, 2013, Pages 84-94

  Deleger, Louise ^a   Molnar, Katalin ^a   Savova, Guergana ^b   Xia, Fei ^c   Lingren, Todd ^a   Li, Qi ^a   Marsolo, Keith ^a   Jegga, Anil ^a   Kaiser, Megan ^a   Stoutenborough, Laura ^a   Solti, Imre ^a  

^a CINCINNATI CHILDREN'S HOSPITAL MEDICAL CENTER   (United States)

^b BOSTON CHILDREN S HOSPITAL   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ALGORITHM; ARTICLE; AUTOMATION; CROSS-SECTIONAL STUDY; HUMAN; INFORMATION PROCESSING; MEDICAL INFORMATION; NATURAL LANGUAGE PROCESSING; PEDIATRIC HOSPITAL; SENSITIVITY ANALYSIS;

ALGORITHMS; CONFIDENTIALITY; CROSS-SECTIONAL STUDIES; DATA MINING; ELECTRONIC HEALTH RECORDS; HOSPITALS, PEDIATRIC; HUMANS; INFORMATION DISSEMINATION; NATURAL LANGUAGE PROCESSING; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; TECHNOLOGY ASSESSMENT, BIOMEDICAL; UNITED STATES;

EID: 84871880219     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2012-001012     Document Type: Article

References (47)

1. Meystre SM, Savova GK, Kipper-Schuler KC, et al. Extracting information from textual documents in the electronic health record: a review of recent research. Yearb Med Inform 2008:128-44.
2. Hicks J. The Potential of Claims Data to Support the Measurement of Health Care Quality. Santa Monica, CA: RAND Corporation, 2003.
3. Jha AK. The promise of electronic records: around the corner or down the road? JAMA 2011;306:880-1.
4. Demner-Fushman D, Chapman WW, McDonald CJ. What can natural language processing do for clinical decision support? J Biomed Inform 2009;42:760-72.
5. Warner JL, Anick P, Hong P, et al. Natural language processing and the oncologic history: is there a match? J Oncol Pract 2011;7:e15-19.
6. Savova GK, Masanz JJ, Ogren PV, et al. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J Am Med Inform Assoc 2010;17:507-13.
7. Zhan C, Miller MR. Administrative data based patient safety research: a critical review. Qual Saf Health Care 2003;12(Suppl 2):ii58-63.
8. Melton GB, Hripcsak G. Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc 2005;12:448-57.
9. Murff HJ, FitzHenry F, Matheny ME, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA 2011;306:848-55.
10. Health Insurance Portability and Accountability Act. P.L. 104-191, 42 U.S.C. 1996.
11. Wolf MS, Bennett CL. Local perspective of the impact of the HIPAA privacy rule on research. Cancer 2006;106:474-9.
12. Dunlop AL, Graham T, Leroy Z, et al. The impact of HIPAA authorization on willingness to participate in clinical research. Ann Epidemiol 2007;17:899-905.
13. Meystre SM, Friedlin FJ, South BR, et al. Automatic de-identification of textual documents in the electronic health record: a review of recent research. BMC Med Res Methodol 2010;10:70.
14. Sweeney L. Replacing personally-identifying information in medical records, the Scrub system. Proc AMIA Annu Fall Symp 1996:333-7.
15. Ruch P, Baud RH, Rassinoux AM, et al. Medical document anonymization with a semantic lexicon. Proc AMIA Symp 2000:729-33.
16. Thomas SM, Mamlin B, Schadow G, et al. A successful technique for removing names in pathology reports using an augmented search and replace method. Proc AMIA Symp 2002:777-81.
17. Berman JJ. Concept-match medical data scrubbing. How pathology text can be used in research. Arch Pathol Lab Med 2003;127:680-6.
18. Fielstein EM, Brown SH, Speroff T, eds. Algorithmic De-identification of VA Medical Exam Text for HIPAA Privacy Compliance: Preliminary Findings. Medinfo. 2004.
19. Gupta D, Saul M, Gilbertson J. Evaluation of a deidentification (De-Id) software engine to share pathology reports and clinical documents for research. Am J Clin Pathol 2004;121:176-86.
20. Beckwith BA, Mahaadevan R, Balis UJ, et al. Development and evaluation of an open source software tool for deidentification of pathology reports. BMC Med Inform Decis Mak 2006;6:12.
21. Friedlin FJ, McDonald CJ. A software tool for removing patient identifying information from clinical documents. J Am Med Inform Assoc 2008;15:601-10.
22. Morrison FP, Li L, Lai AM, et al. Repurposing the clinical record: can an existing natural language processing system de-identify clinical notes? J Am Med Inform Assoc 2009;16:37-9.
23. Neamatullah I, Douglass MM, Lehman LW, et al. Automated de-identification of free-text medical records. BMC Med Inform Decis Mak 2008;8:32.
24. Taira RK, Bui AA, Kangarloo H. Identification of patient name references within medical documents using semantic selectional restrictions. Proc AMIA Symp 2002:757-61.
25. Uzuner O, Sibanda TC, Luo Y, et al. A de-identifier for medical discharge summaries. Artif Intell Med 2008;42:13-35.
26. Gardner J, Xiong L. HIDE: an integrated system for health information DEidentification. Comp Med Sy 2008:254-9.
27. Arakami E, ed. Automatic Deidentification by Using Sentence Features and Label Consistency. I2b2 Workshop on Challenges in Natural Language Processing for Clinical Data. 2006.
28. Guo Y, Gaizauskas R, Roberts I, et al, eds. Identifying Personal Health Information Using Support Vector Machines. I2b2 Workshop on Challenges in Natural Language Processing for Clinical Data. 2006.
29. Hara K, ed. Applying a SVM Based Chunker and a Text Classifier to the Deid Challenge. I2b2 Workshop on Challenges in Natural Language Processing for Clinical Data. 2006.
30. Szarvas G, Farkas R, Busa-Fekete R. State-of-the-art anonymization of medical records using an iterative machine learning framework. J Am Med Inform Assoc 2007;14:574-80.
31. Wellner B, Huyck M, Mardis S, et al. Rapidly retargetable approaches to deidentification in medical records. J Am Med Inform Assoc 2007;14:564-73.
32. Aberdeen J, Bayer S, Yeniterzi R, et al. The MITRE Identification Scrubber Toolkit: design, training, and assessment. Int J Med Inform 2010;79:849-59.
33. Benton A, Hill S, Ungar L, et al. A system for de-identifying medical message board text. BMC Bioinformatics 2011;12(Suppl 3):S2.
34. Gardner J, Xiong L, Wang F, et al. An evaluation of feature sets and sampling techniques for de-identification of medical records. In: Veinot T, ed. Proceedings of the 1st ACM International Health Informatics Symposium (IHI '10). New York, NY, USA: ACM, 2010:183-90.
35. Uzuner O, Luo Y, Szolovits P. Evaluating the state-of-the-art in automatic deidentification. J Am Med Inform Assoc 2007;14:550-63.
36. McCallum AC. MALLET: a Machine Learning for Language Toolkit. 2002.
37. Lafferty J, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data. Proc. 18th International Conf. on Machine Learning. Morgan Kaufmann San Francisco, CA, USA, 2001:282-9.
38. Schmid H. Probabilistic part-of-speech tagging using decision trees. Proceedings of International Conference on New Methods in Language Processing. Manchester, UK, 1994.
39. Friedman C, Hripcsak G. Evaluating natural language processors in the clinical domain. Methods Inf Med 1998;37:334-44.
40. Hripcsak G, Rothschild AS. Agreement, the f-measure, and reliability in information retrieval. J Am Med Inform Assoc 2005;12:296-8.
41. Noreen EW. Computer-Intensive Methods for Testing Hypotheses: An Introduction. New-York: Wiley, 1989.
42. Cinchor N. The statistical significance of MUC4 results. MUC4 '92 Proceedings of the 4th Conference on Message Understanding; 1992. Association for Computational Linguistics, Stroudsburg, PA, USA.
43. Ogren P, Savova G, Chute C. Constructing evaluation corpora for automated clinical named entity recognition. Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08), European Language Resources Association (ELRA). Marrakech, Morocco, 2008.
44. Goldberger AL, Amaral LA, Glass L, et al. PhysioBank, PhysioToolkit, and Physionet: components of a new research resource for complex physiologic signals. Circulation 2000;101:E215-20.
45. Minkov E, Wang R, Tomasic A, et al. NER Systems that Suit User's Preferences: Adjusting the Recall-Precision Trade-off for Entity Extraction. Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers 2006:93-6.
46. Halgrim S, Xia F, Solti I, et al. Extracting medication information from discharge summaries. Proceedings of the NAACL HLT 2010 Second Louhi Workshop on Text and Data Mining of Health Documents. Association for Computational Linguistics, Stroudsburg, PA, USA. 2010:61-7.
47. Uzuner O, Solti I, Cadag E. Extracting medication information from clinical text. J Am Med Inform Assoc 2010;17:514-18.