Developing a standard for de-identifying electronic patient records written in Swedish: Precision, recall and F-measure in a manual and computerized annotation trial

International Journal of Medical Informatics

Volumn 78, Issue 12, 2009, Pages

  Velupillai, Sumithra ^a   Dalianis, Hercules ^a   Hassel, Martin ^a   Nilsson, Gunnar H ^b  

^a STOCKHOLM UNIVERSITY   (Sweden)

^b KAROLINSKA INSTITUTE   (Sweden)

Author keywords

Annotation; Electronic patient records in Swedish; Ethical issues; Medical informatics applications; Medical record systems; Natural language processing; Protected health information

Indexed keywords

ELECTRONIC PATIENT RECORD; ETHICAL ISSUES; MEDICAL INFORMATICS APPLICATIONS; MEDICAL RECORD SYSTEMS; NATURAL LANGUAGE PROCESSING; PROTECTED HEALTH INFORMATIONS;

COMPUTATIONAL LINGUISTICS; COMPUTER SOFTWARE; GOLD; HEALTH; INFORMATION SCIENCE; STANDARDIZATION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

ACCURACY; ARTICLE; COMPUTER PROGRAM; COMPUTER SECURITY; ELECTRONIC MEDICAL RECORD; INFORMATION RETRIEVAL; LANGUAGE PROCESSING; LEGAL ASPECT; MEDICAL ETHICS; MEDICAL INFORMATICS; PRIORITY JOURNAL; PRIVACY; RECALL; STANDARD; SWEDEN;

CONFIDENTIALITY; ELECTRONIC HEALTH RECORDS; HUMANS; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; NATURAL LANGUAGE PROCESSING; SWEDEN;

EID: 71549144430     PISSN: 13865056     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2009.04.005     Document Type: Article

References (22)

1. Sweeney L. Replacing personally-identifying information in medical records, the Scrub system. Proc. AMIA Annu. Fall Symp. (1996) 333-337
2. Neamatullah I.M., Douglass M., Lehman L.H., Reisner A., Villarroel M., Long W.J., Szolovits P., Moody G.B., Mark R.G., and Clifford G.D. Automated de-identification of free text medical records. BMC Medical Informatics and Decision Making 8 (2008) 32 10.1186/1472-6947-8-32
3. Sibanda T., and Uzuner O. Role of local context in automatic de-identification of ungrammatical, fragmented text. Proc. HLT-NAACL 2006. New York (2006)
4. i2b2, Informatics for integrating biology and the bedside, 2008. Available at: http://www.i2b2.org (accessed October 31, 2008).
5. Uzuner O., Luo Y., and Szolovits P. Evaluating the state-of-the-art in automatic de-identification. Journal of the American Medical Informatics Association 14 5 (September) (2007) 550-563
6. Szarvas G., Farkas R., and Busa-Fekete R. State-of-the-art anonymization of medical records using an iterative machine learning framework. Journal of the American Medical Informatics Association 14 (2007) 574-580
7. Uzuner O.T.C., Sibandam Y., Luo Y., and Szolovits P. A de-identifier for medical discharge summaries. Journal of Artificial Intelligence in Medicine 42 1 (January) (2008) 13-35
8. Kokkinakis D., and Thurin A. Identification of entity references in hospital discharge letters. Proc. 16th Nordic Conference on Computational Linguistics NODALIDA-2007 (2007), University of Tartu, Tartu
9. Artstein R., and Poesio M. Inter-coder agreement for computational linguistics. Journal of Computational Linguistics 34 4 (December) (2008) 555-596
10. Wilbur W.J., Rzhetsky A., and Shatkay H. New directions in biomedical text annotation: definitions, guidelines and corpus construction. BMC Bioinformatics 7 (2006) 356
11. Velupillai S., Dalianis H., and Hassel M. Diagnosing diagnoses in Swedish Clinical Records. In: Karsten H., Back B., Salakoski T., Salanterä S., and Suominen H. (Eds). Proc. First Conference on Text and Data Mining of Clinical Documents. Turku, Louhi'08, September 3-4 (2008) 110-112
12. HIPAA, Health Insurance Portability and Accountability (HIPAA), Privacy Rule and Public Health Guidance, 2003. From CDC and the U.S. Department of Health and Human Services, April 11, 2003. Available at: http://www.cdc.gov/mmwr/preview/mmwrhtml/m2e411a1.htm (accessed October 31, 2008).
13. Ogren P. Knowtator: a Protégé plug-in for annotated corpus construction. Proc. HLT-NAACL 2006. Morristown, NJ, USA, ACL (2006) 273-275
14. Protégé, 2008. Available at: http://protege.stanford.edu/ (accessed October 31, 2008).
15. FASS, 2008. Available at: http://npl.mpa.se/mpa.npl.services/home2.aspx (accessed October 31, 2008).
16. Svenska Namn. Available at: http://www.svenskanamn.se/ (Swedish names, in Swedish) (accessed February 27, 2009).
17. H. Dalianis, E. Åström, SweNam-a Swedish Named Entity Recognizer, Its Construction, Training and Evaluation, Technical Report, TRITA-NA-P0113, IPLab-NADA, KTH, June 2001.
18. F. Olsson, Bootstrapping named entity annotation by means of active machine learning, A method for creating corpora, Ph.D. Thesis, University of Gothenburg, 2008, ISBN 978-91-87850-37.
19. Mani I., Hu Z., Bae Jang S., Samuel K., Krause M., Phillips J., and Wu C.H. Protein name tagging guidelines: lessons learned. Comparative and Functional Genomics 1-2 (2005), John Wiley & Sons, Ltd. pp. 72-76
20. Chinchor N., and Sundheim B. MUC-5 evaluation metrics. MUC5'93: Proc. Fifth Conference on Message Understanding (1993), Association for Computational Linguistics, Baltimore, MD 69-78
21. Hirschman L., Yeh A., Blaschke C., and Valencia A. Overview of BioCreAtIvE: critical assessment of information extraction for biology. BMC Bioinformatics 6 Suppl. 1 (2005) S1
22. C. Grouin, A. Rosier, O. Dameron, P. Zweigenbaum, Testing tactics to localize de-identification, in: MIE 2009: Proc. 22nd Conference of the European Federation for Medical Informatics, Sarajevo, Bosnia and Herzegovina, 2009.