Automatic de-identification of electronic medical records using token-level and character-level conditional random fields

Journal of Biomedical Informatics

Volumn 58, Issue , 2015, Pages S47-S52

  Liu, Zengjian ^a   Chen, Yangxin ^b   Tang, Buzhou ^a   Wang, Xiaolong ^a   Chen, Qingcai ^a   Li, Haodi ^a   Wang, Jingfeng ^b   Deng, Qiwen ^c   Zhu, Suisong ^c  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b SUN YAT SEN MEMORIAL HOSPITAL OF SUN YAT SEN UNIVERSITY   (China)

^c The 6th Affiliated Hospital of Shenzhen University Health Science Center   (China)

Author keywords

De identification; Electronic medical records; Hybrid method; I2b2; Natural language processing; Protected health information

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL LINGUISTICS; HYBRID SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MEDICAL COMPUTING; RANDOM PROCESSES;

DE-IDENTIFICATION; ELECTRONIC MEDICAL RECORD; HYBRID METHOD; I2B2; NATURAL LANGUAGE PROCESSING; PROTECTED HEALTH INFORMATIONS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

ACCURACY; ARTICLE; CLASSIFIER; ELECTRONIC MEDICAL RECORD; INFORMATION PROCESSING; INFORMATION RETRIEVAL; MACHINE LEARNING; PRIORITY JOURNAL; SCORING SYSTEM; AUTOMATED PATTERN RECOGNITION; CHINA; COHORT ANALYSIS; COMPUTER SECURITY; CONFIDENTIALITY; CONTROLLED VOCABULARY; DATA MINING; ELECTRONIC HEALTH RECORD; NATURAL LANGUAGE PROCESSING; ORGANIZATION AND MANAGEMENT; PROCEDURES; STATISTICAL ANALYSIS; VERBAL COMMUNICATION;

CHINA; COHORT STUDIES; COMPUTER SECURITY; CONFIDENTIALITY; DATA INTERPRETATION, STATISTICAL; DATA MINING; ELECTRONIC HEALTH RECORDS; NARRATION; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; VOCABULARY, CONTROLLED;

EID: 84945535937     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2015.06.009     Document Type: Article

References (32)

1. Act A. Health insurance portability and accountability act of 1996. Public Law 1996, 104:191.
2. Uzuner Ö., Luo Y., Szolovits P. Evaluating the state-of-the-art in automatic de-identification. J. Am. Med. Inform. Assoc. 2007, 14(5):550-563.
3. Meystre S.M., Friedlin F.J., South B.R., Shen S., Samore M.H. Automatic de-identification of textual documents in the electronic health record: a review of recent research. BMC Med. Res. Methodol. 2010, 10(1):70.
4. Ferrandez O., South B.R., Shen S., Friedlin F.J., Samore M.H., Meystre S.M. Evaluating current automatic de-identification methods with veteran's health administration clinical documents. BMC Med. Res. Methodol. 2012, 12(1):109.
5. Deleger L., Molnar K., Savova G., Xia F., Lingren T., Li Q., Marsolo K., Jegga A., Kaiser M., Stoutenborough L. Large-scale evaluation of automated clinical note de-identification and its impact on information extraction. J. Am. Med. Inform. Assoc. 2013, 20(1):84-94.
6. Sweeney L. Replacing personally-identifying information in medical records, the scrub system. Proceedings of the AMIA Annual Fall Symposium 1996, 333-337. American Medical Informatics Association.
7. Ruch P., Baud R.H., Rassinoux A.-M., Bouillon P., Robert G. Medical document anonymization with a semantic lexicon. Proceedings of the AMIA Symposium 2000, 729-733. American Medical Informatics Association.
8. Thomas S.M., Mamlin B., Schadow G., McDonald C. A successful technique for removing names in pathology reports using an augmented search and replace method. Proceedings of the AMIA Symposium 2002, 777-781. American Medical Informatics Association.
9. Gupta D., Saul M., Gilbertson J. Evaluation of a deidentification (De-id) software engine to share pathology reports and clinical documents for research. Am. J. Clin. Pathol. 2004, 121(2):176-186.
10. Beckwith B.A., Mahaadevan R., Balis U.J., Kuo F. Development and evaluation of an open source software tool for deidentification of pathology reports. BMC Med. Inform. Decis. Making 2006, 6(1):12.
11. Friedlin F.J., McDonald C.J. A software tool for removing patient identifying information from clinical documents. J. Am. Med. Inform. Assoc. 2008, 15(5):601-610.
12. Neamatullah I., Douglass M.M., Li-wei H.L., Reisner A., Villarroel M., Long W.J., Szolovits P., Moody G.B., Mark R.G., Clifford G.D. Automated de-identification of free-text medical records. BMC Med. Inform. Decis. Making 2008, 8(1):32.
13. R. Guillen, Automated de-identification and categorization of medical records, in: i2b2 Workshop on Challenges in Natural Language Processing for Clinical Data, 2006.
14. E. Aramaki, T. Imai, K. Miyo, K. Ohe, Automatic deidentification by using sentence features and label consistency, in: i2b2 Workshop on Challenges in Natural Language Processing for Clinical Data, 2006.
15. Y. Guo, R. Gaizauskas, I. Roberts, G. Demetriou, M. Hepple, Identifying personal health information using support vector machines, in: i2b2 Workshop on Challenges in Natural Language Processing for Clinical Data, 2006.
16. Szarvas G., Farkas R., Busa-Fekete R. State-of-the-art anonymization of medical records using an iterative machine learning framework. J. Am. Med. Inform. Assoc. 2007, 14(5):574-580.
17. K. Hara, Applying a SVM based Chunker and a text classifier to the deid challenge, in: i2b2 Workshop on Challenges in Natural Language Processing for Clinical Data, 2006.
18. Wellner B., Huyck M., Mardis S., Aberdeen J., Morgan A., Peshkin L., Yeh A., Hitzeman J., Hirschman L. Rapidly retargetable approaches to de-identification in medical records. J. Am. Med. Inform. Assoc. 2007, 14(5):564-573.
19. Lafferty J.D., McCallum A., Pereira F.C.N. Conditional random fields: probabilistic models for segmenting and labeling sequence data. Proceedings of the Eighteenth International Conference on Machine Learning, ICML '01 2001, 282-289. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
20. Cortes C., Vapnik V. Support-vector networks. Mach. Learn. 1995, 20(3):273-297.
21. Freund Y., Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. Computational Learning Theory 1995, 23-37. Springer.
22. S. Amber, K. Christopher, X. Hua, U. Özlem, Practical applications for NLP in clinical research: the 2014 i2b2/UTHealth shared tasks, in: 2014 i2b2 Clinical NLP Challenge, J. Biomed. Inform. 58S (2015) S1-S5.
23. S. Amber, U. Özlem, Annotating longitudinal clinical narratives for de-identification: The 2014 i2b2/UTHealth corpus, J. Biomed. Inform. 58S (2015) S20-S29.
24. Xu H., Stenner S.P., Doan S., Johnson K.B., Waitman L.R., Denny J.C. MedEx: a medication information extraction system for clinical narratives. J. Am. Med. Inform. Assoc. 2010, 17(1):19-24.
25. Toutanova K., Klein D., Manning C.D., Singer Y. Feature-rich part-of-speech tagging with a cyclic dependency network. Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology 2003, vol. 1:173-180. Association for Computational Linguistics.
26. Finkel J.R., Grenager T., Manning C. Incorporating non-local information into information extraction systems by gibbs sampling. Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics 2005, 363-370. Association for Computational Linguistics.
27. Tang B., Cao H., Wu Y., Jiang M., Xu H. Recognizing clinical entities in hospital discharge summaries using structural support vector machines with word representation features. BMC Med. Inform. Decis. Making 2013, 13(Suppl. 1):S1.
28. B. Tang, X. Wang, Y. Wu, M. Jiang, J. Wang, H. Xu, Recognizing chemical entities in biomedical literature using conditional random fields and structured support vector machines, in: BioCreative Challenge Evaluation Workshop, vol. 2, 2013, pp. 70-74.
29. Tang B., Wu Y., Jiang M., Chen Y., Denny J.C., Xu H. A hybrid system for temporal information extraction from clinical text. J. Am. Med. Inform. Assoc. 2013, 20:828-835.
30. Tang B., Cao H., Wang X., Chen Q., Xu H. Evaluating word representation features in biomedical named entity recognition tasks. BioMed Res. Int. 2014, 2014:240403.
31. Brown P.F., Desouza P.V., Mercer R.L., Pietra V.J.D., Lai J.C. Class-based n-gram models of natural language. Comput. Linguist. 1992, 18(4):467-479.
32. T. Mikolov, I. Sutskever, K. Chen, G.S. Corrado, J. Dean, Distributed representations of words and phrases and their compositionality, in: Advances in Neural Information Processing Systems, 2013, pp. 3111-3119.