De-identification of patient notes with recurrent neural networks

Journal of the American Medical Informatics Association

Volumn 24, Issue 3, 2017, Pages 596-606

  Dernoncourt, Franck ^a   Lee, Ji Young ^a   Uzuner, Ozlem ^b   Szolovits, Peter ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

De identi cation; Medical language processing; Neural networks

Indexed keywords

CONTROLLED STUDY; DATA BASE; ELECTRONIC HEALTH RECORD; ERROR; HUMAN; LANGUAGE PROCESSING; MODEL; NERVOUS SYSTEM; RECALL; SCIENTIST; ANONYMIZATION; ARTIFICIAL NEURAL NETWORK; COMPARATIVE STUDY; INFORMATION PROCESSING;

DATA ANONYMIZATION; DATASETS AS TOPIC; ELECTRONIC HEALTH RECORDS; HUMANS; NEURAL NETWORKS (COMPUTER);

EID: 85019722825     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1093/jamia/ocw156     Document Type: Article

References (58)

1. DesRoches CM, Worzala C, Bates S. Some hospitals are falling behind in meeting "meaningful use" criteria and could be vulnerable to penalties in 2015. Health Affairs. 2013;32:1355-1360.
2. Wright A, Henkin S, Feblowitz, et al. Early results of the meaningful use program for electronic health records. New Engl J Med. 2013;368:779-780.
3. Office for Civil Rights H. Standards for privacy of individually identifiable health information. Final rule. Federal Register. 2002;67:53181.
4. Neamatullah I, Douglass MM, Li-wei HL, et al. Automated deidentification of free-text medical records. BMC Med Inform Decis Mak. 2008;8:1.
5. Douglass M, Clifford G, Reisner A, et al. De-identification algorithm for free-text nursing notes. Comput Cardiol. 2005:331-334.
6. Douglas M, Clifford G, Reisner A, et al. Computer-assisted deidentification of free text in the MIMIC II database. Comput Cardiol. 2004:341-344.
7. Goldberger AL, Amaral LA, Glass L, et al. Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals. Circulation. 2000;101:e215-e220.
8. Saeed M, Villarroel M, Reisner AT, et al. Multiparameter intelligent monitoring in intensive care II (MIMIC-II): A public-access intensive care unit database. Crit Care Med. 2011;39:952.
9. Lingren T, Deleger L, Molnar K, et al. Pre-annotating clinical notes and clinical trial announcements for gold standard corpus development: Evaluating the impact on annotation speed and potential bias. Proc 2012 IEEE 2nd Conf Healthc Informatics, Imaging Syst Biol HISB 2012. 2012:108. doi:10.1109/HISB.2012.33.
10. South BR, Mowery D, Suo Y, et al. Evaluating the effects of machine pre-annotation and an interactive annotation interface on manual de-identification of clinical text. J Biomed Inform. 2014;50: 162-172.
11. Hanauer D, Aberdeen J, Bayer S, et al. Bootstrapping a de-identification system for narrative patient records: Cost-performance tradeoffs. Int J Med Inform. 2013;82(9):821-831.
12. Gobbel GT, Garvin J, Reeves R, et al. Assisted annotation of medical free text using RapTAT. J Am Med Inform Assoc. 2014;21(5):833-841.
13. Chiticariu L, Li Y, Reiss FR. Rule-based information extraction is dead! Long live rule-based information extraction systems! EMNLP. 2013:827-832.
14. Berman JJ. Concept-match medical data scrubbing: how pathology text can be used in research. Arch Pathol Lab Med. 2003;127:680-686.
15. Beckwith BA, Mahaadevan R, Balis UJ, et al. Development and evaluation of an open source software tool for deidentification of pathology reports. BMC Med Inform Decis Mak. 2006;6:1.
16. Fielstein E, Brown S, Speroff T. Algorithmic de-identification of VA medical exam text for HIPAA privacy compliance: preliminary findings. Medinfo. 2004;1590.
17. Friedlin FJ, McDonald CJ. A software tool for removing patient identifying information from clinical documents. J Am Med Inform Assoc. 2008;15:601-610.
18. Gupta D, Saul M, Gilbertson J. Evaluation of a deidentification (De-Id) software engine to share pathology reports and clinical documents for research. Am J Clin Pathol. 2004;121:176-186.
19. Morrison FP, Li L, Lai AM, et al. Repurposing the clinical record: Can an existing natural language processing system de-identify clinical notes? J Am Med Inform Assoc. 2009;16:37-39.
20. Ruch P, Baud RH, Rassinoux A-M, et al. Medical document anonymization with a semantic lexicon. Proc AMIA Symp. 2000:729-733.
21. Sweeney L. Replacing personally identifying information in medical records, the Scrub system. Proc AMIA Annual Fall Symp. 1996:333-337.
22. Thomas SM, Mamlin B, Schadow G, et al. A successful technique for removing names in pathology reports using an augmented search and replace method. Proc AMIA Symp. 2002:777-781.
23. Szarvas G, Farkas R, Kocsor A. A multilingual named entity recognition system using boosting and c4.5 decision tree learning algorithms. Discovery Sci. 2006;4265:267-278.
24. Guo Y, Gaizauskas R, Roberts I, et al. Identifying personal health information using support vector machines. I2b2 Workshop on Challenges in Natural Language Processing for Clinical Data. 2006:10-11.
25. Uzuner €O, Sibanda TC, Luo Y, et al. P. A de-identifier for medical discharge summaries. Artif Intell Med. 2008;42:13-35.
26. Hara K. Applying a SVM based chunker and a text classifier to the deid challenge. I2b2 Workshop on Challenges in Natural Language Processing for Clinical Data. 2006:10-11.
27. Aberdeen J, Bayer S, Yeniterzi R, et al. The MITRE Identification Scrubber Toolkit: Design, training, and assessment. Int J Med Inform. 2010;79:849-859.
28. Meystre SM, Friedlin FJ, South BR, et al. Automatic de-identification of textual documents in the electronic health record: a review of recent research. BMC Med Res Methodol. 2010;10:1.
29. Stubbs A, Kotfila C, Uzuner O. Automated systems for the deidentification of longitudinal clinical narratives: overview of 2014 i2b2/UTHealth shared task track 1. J Biomed Inform. 2015;58:S11-S19.
30. Mikolov T, Sutskever I, Chen K, et al. Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst, 2013:3111-3119.
31. Collobert R, Weston J, Bottou L, et al. Natural language processing (almost) from scratch. J Mach Learning Res. 2011;12:2493-2537.
32. Pennington J, Socher R, Manning CD. GloVe: Global vectors for word representation. Proc Empiricial Methods Natural Language Processing (EMNLP 2014). 2014;12:1532-1543.
33. Mikolov T, Karafiaat M, Burget L, et al. Recurrent neural network based language model. Interspeech. 2010:3.
34. Socher R, Perelygin A, Wu JY, et al. Recursive deep models for semantic compositionality over a sentiment treebank. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 2013;1642:18-21.
35. Kim Y. Convolutional neural networks for sentence classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014:1746-1751.
36. Blunsom P, Grefenstette E, Kalchbrenner N, et al. A convolutional neural network for modelling sentences. Proceedings of the 52nd AnnualMeeting of the Association for Computational Linguistics. 2014;1:655-665.
37. Lee JY, Dernoncourt F. Sequential short-text classification with recurrent and convolutional neural networks. Human Language Technologies 2016: The Conference of the North American Chapter of the Association for Computational Linguistics. 2016:515-520.
38. Weston J, Bordes A, Chopra S, et al. Towards AI-complete question answering: a set of prerequisite toy tasks. arXiv preprint arXiv:1502.05698. 2015.
39. Wang D, Nyberg E. A long short-term memory model for answer sentence selectioninquestionanswering. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (vol. 2: short papers) [Internet]. Beijing, China: Association for Computational Linguistics; 2015:707-712.
40. Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. 2014.
41. Tamura A, Watanabe T, Sumita E. Recurrent neural networks for word alignment model. ACL (1). 2014;52:1470-1480.
42. Sundermeyer M, Alkhouli T, Wuebker J, et al. Translation modeling with bidirectional recurrent neural networks. EMNLP. 2014:14-25.
43. Lample G, Ballesteros M, Subramanian S, et al. Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360. 2016.
44. Labeau M, Löser K, Allauzen A. Non-lexical neural architecture for finegrained POS tagging. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing [Internet]. Lisbon, Portugal: Association for Computational Linguistics; 2015;14:232-237.
45. Kim Y, Jernite Y, Sontag D, et al. Character-aware neural language models. arXiv preprint arXiv:1508.06615. 2015.
46. Wu Y, Jiang M, Lei J, et al. Named entity recognition in Chinese clinical text using deep neural network. Stud Health Technol Inform. 2015;216:624-628.
47. Li P, Huang H. UTA DLNLP at SemEval-2016 Task 12: deep learning based natural language processing system for clinical information identification from clinical notes and pathology reports. In: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016).San Diego, CA: Association for Computational Linguistics; 2016;10:1268-1273.
48. Fries JA. Brundlefly at SemEval-2016 Task 12: recurrent neural networks vs. joint inference for clinical temporal information extraction. In: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016). San Diego, CA: Association for Computational Linguistics; 2016:1274-1279.
49. Zhang C. DeepDive: a data management system for automatic knowledge base construction. Thesis. 2015;53:1689-1699.
50. Manning CD, Bauer J, Finkel J, et al. The Stanford CoreNLP Natural Language Processing Toolkit. Proc 52nd Annu Meet Assoc Comput Linguist Syst Demonstr. 2014;52:55-60.
51. Yang H, Garibaldi JM. Automatic detection of protected health information from clinic narratives. J Biomed Inform. 2015;58:S30-S38.
52. Filannino M, Brown G, Nenadic G. ManTIME: temporal expression identification and normalization in the TempEval-3 challenge. CoRR. 2013;abs/1304.7(2005):5.
53. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9:1735-1780.
54. Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781. 2013.
55. Mikolov T, Yih W-t, Zweig G. Linguistic regularities in continuous space word representations. HLT-NAACL. 2013;13:746-751.
56. Johnson AEW, Pollard TJ, Shen L, et al. MIMIC-III, a freely accessible critical care database. Scientific Data. 2016; 3:160035.
57. Douglass M. Computer-assisted De-identification of Free-Text Nursing Notes [Master's thesis]. Cambridge, United States: Massachusetts Institute of Technology; 2005.
58. Parker R, Graff D, Kong J, et al. English Gigaword Fifth Edition, Linguistic Data Consortium. Technical Report. Philadelphia: Linguistic Data Consortium; 2011.