Use of “off-the-shelf” information extraction algorithms in clinical informatics: A feasibility study of MetaMap annotation of Italian medical notes

Journal of Biomedical Informatics

Volumn 63, Issue , 2016, Pages 22-32

  Chiaramello, Emma ^a   Pinciroli, Francesco ^a,b   Bonalumi, Alberico ^c   Caroli, Angelo ^c   Tognola, Gabriella ^a  

^a Istituto Di Elettronica E Di Ingegneria Dell'informazione E Delle Telecomunicazioni Turin   (Italy)

^b POLITECNICO DI MILANO   (Italy)

^c FONDAZIONE IRCCS CA GRANDA OSPEDALE MAGGIORE POLICLINICO   (Italy)

Author keywords

EHR data reuse; Failure analysis; Information extraction; Italian language; MetaMap; Unstructured clinical notes

Indexed keywords

ALGORITHMS; COMPUTATIONAL LINGUISTICS; DATA MINING; FAILURE ANALYSIS; INFORMATION ANALYSIS; INFORMATION RETRIEVAL; SEMANTICS; TRANSLATION (LANGUAGES);

AUTOMATIC TRANSLATION; CLINICAL INFORMATICS; CLINICAL NOTES; DATA REUSE; FEASIBILITY STUDIES; ITALIAN LANGUAGE; METAMAP; UNIFIED MEDICAL LANGUAGE SYSTEMS;

MEDICAL INFORMATION SYSTEMS;

ACCURACY; ALGORITHM; ARTICLE; AUTOMATION; COMPUTER PROGRAM; CONCEPT ANALYSIS; DATA BASE; EXPERIMENTAL STUDY; FEASIBILITY STUDY; INFORMATION PROCESSING; INFORMATION RETRIEVAL; ITALY; LANGUAGE; MEDICAL INFORMATICS; MEDICAL INFORMATION; MEDICAL INFORMATION SYSTEM; MEDICAL LITERATURE; OFF THE SHELF INFORMATION EXTRACTION ALGORITHM; PRIORITY JOURNAL; SEMANTICS; HUMAN; NATURAL LANGUAGE PROCESSING; UNIFIED MEDICAL LANGUAGE SYSTEM;

ALGORITHMS; FEASIBILITY STUDIES; HUMANS; INFORMATION STORAGE AND RETRIEVAL; ITALY; NATURAL LANGUAGE PROCESSING; UNIFIED MEDICAL LANGUAGE SYSTEM;

EID: 84979695848     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2016.07.017     Document Type: Article

References (42)

1. [1] Meystre, S.M., Savova, G.K., Kipper-Schuler, K.C., Hurdle, J.F., Extracting information from textual documents in the electronic health record: a review of recent research. Yearb Med Inf. 35 (2008), 128–144.
2. [2] Demner-Fushman, D., Chapman, W.W., McDonald, C.J., What can natural language processing do for clinical decision support?. J. Biomed. Inform. 42 (2009), 760–772, 10.1016/j.jbi.2009.08.007.
3. [3] Pai, V.M., Rodgers, M., Conroy, R., Luo, J., Zhou, R., Seto, B., Workshop on using natural language processing applications for enhancing clinical decision making: an executive summary. J. Am. Med. Informatics Assoc. 21 (2014), e2–e5, 10.1136/amiajnl-2013-001896.
4. [4] Pradhan, S., Elhadad, N., South, B.R., Martinez, D., Christensen, L., Vogel, A., et al. Evaluating the state of the art in disorder recognition and normalization of the clinical narrative. J. Am. Med. Inform. Assoc. 22 (2015), 143–154, 10.1136/amiajnl-2013-002544.
5. [5] Chapman, W.W., Fiszman, M., Dowling, J.N., Chapman, B.E., Rindflesch, T.C., Identifying respiratory findings in emergency department reports for biosurveillance using MetaMap. Stud. Health Technol. Inform. 107 (2004), 487–491.
6. [6] Cui, L., Sahoo, S.S., Lhatoo, S.D., Garg, G., Rai, P., Bozorgi, A., et al. Complex epilepsy phenotype extraction from narrative clinical discharge summaries. J. Biomed. Inform. 51 (2014), 272–279, 10.1016/j.jbi.2014.06.006.
7. [7] Shivade, C., Raghavan, P., Fosler-Lussier, E., Embi, P.J., Elhadad, N., Johnson, S.B., et al. A review of approaches to identifying patient phenotype cohorts using electronic health records. J. Am. Med. Inform. Assoc. 21 (2013), 221–230, 10.1136/amiajnl-2013-001935.
8. [8] Hanauer, D.a., Saeed, M., Zheng, K., Mei, Q., Shedden, K., Aronson, A.R., et al. Applying MetaMap to Medline for identifying novel associations in a large clinical dataset: a feasibility analysis. J. Am. Med. Inform. Assoc., 2014, 925–937, 10.1136/amiajnl-2014-002767.
9. [9] Jensen, P.B., Jensen, L.J., Brunak, S., Mining electronic health records: towards better research applications and clinical care. Nat. Rev. Genet. 13 (2012), 395–405, 10.1038/nrg3208.
10. [10] Wang, X., Hripcsak, G., Markatou, M., Friedman, C., Active computerized pharmacovigilance using natural language processing, statistics, and electronic health records: a feasibility study. J. Am. Med. Informatics Assoc. 16 (2009), 328–337, 10.1197/jamia.M3028.
11. [11] Iyer, S.V., Harpaz, R., LePendu, P., Bauer-Mehren, A., Shah, N.H., Mining clinical text for signals of adverse drug-drug interactions. J. Am. Med. Inform. Assoc. 21 (2014), 353–362, 10.1136/amiajnl-2013-001612.
12. [12] Leaman, R., Khare, R., Lu, Z., Challenges in clinical natural language processing for automated disorder normalization. J. Biomed. Inform. 57 (2015), 28–37, 10.1016/j.jbi.2015.07.010.
13. [13] D. Jurafsky, J.H. Martin, Speech and Language Processing: An introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (Introduction), 2008. http://dx.doi.org/10.1016/S0065-230X(09)04001-9.
14. [14] Skeppstedt, M., Kvist, M., Nilsson, G.H., Dalianis, H., Automatic recognition of disorders, findings, pharmaceuticals and body structures from clinical text: an annotation and machine learning study. J. Biomed. Inform. 49 (2014), 148–158, 10.1016/j.jbi.2014.01.012.
15. [15] Castro, E., Iglesias, A., Martínez, P., Castaño, L., Automatic identification of biomedical concepts in spanish-language unstructured clinical texts. Proc. 1st ACM Int. Heal. Informatics Symp, 2010, 751–757, 10.1145/1882992.1883106.
16. [16] Demner-fushman, D., Mork, J.G., Shooshan, S.E., Aronson, A.R., UMLS content views appropriate for NLP processing of the biomedical literature vs. clinical text. J. Biomed Inform. 43 (2010), 587–594, 10.1016/j.jbi.2010.02.005.
17. [17] Sager, N., Lyman, M., Bucknall, C., Nhan, N., Tick, L.J., Natural language processing and the representation of clinical data. J. Am. Med. Informatics Assoc. 1 (1994), 142–160, 10.1136/jamia.1994.95236145.
18. [18] Friedman, C., Hripcsak, G., DuMouchel, W., Johnson, S.B., Clayton, P.D., Natural language processing in an operational clinical information system. Nat. Lang. Eng. 1 (1995), 83–108, 10.1017/S1351324900000061.
19. [19] Friedman, C., Towards a comprehensive medical language processing system: methods and issues. Proc. AMIA Annu. Fall Symp., 1997, 595–599.
20. [20] Aronson, A., Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. AMIA Annu. Symp. Proc, 2001, 17–21.
21. [21] Brennan, P.F., Aronson, A.R., Towards linking patients and clinical information: detecting UMLS concepts in e-mail. J. Biomed. Inform. 36 (2003), 334–341, 10.1016/j.jbi.2003.09.017.
22. [22] Park, A., Hartzler, A., Huh, J., McDonald, D.W., Pratt, W., Automatically detecting failures in natural language processing tools for online community text. J. Med. Internet Res., 17, 2015, 10.2196/jmir.4612.
23. [23] Meystre, S., Haug, P.J., Evaluation of medical problem extraction from electronic clinical documents using MetaMap Transfer (MMTx). Stud. Health Technol. Inform. 116 (2005), 823–828.
24. [24] Meystre, S., Haug, P.J., Natural language processing to extract medical problems from electronic clinical documents: performance evaluation. J. Biomed. Inform. 39 (2006), 589–599, 10.1016/j.jbi.2005.11.004.
25. [25] Lependu, P., Iyer, S.V., Fairon, C., Shah, N.H., Annotation analysis for testing drug safety signals using unstructured clinical notes. J. Biomed. Semantics., 3(Suppl. 1), 2012, S5, 10.1186/2041-1480-3-S1-S5.
26. [26] Bodenreider, O., The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res., 32, 2004, 10.1093/nar/gkh061 D267-70.
27. [27] Oronoz, M., Casillas, A., Gojenola, K., Perez, A., Automatic annotation of medical records in spanish with disease, drug and substance names. Prog. Pattern Recognition, Image Anal. Comput. Vision, Appl., 2013, Springer, Berlin, Heidelberg, 536–543, 10.1007/978-3-642-41827-3_67.
28. [28] Delbecque, T., Zweigenbaum, P., MetaCoDe: a lightweight {UMLS} mapping tool. Artif. Intell. Med., 2007, Springer, Berlin, Heidelberg, 242–246.
29. [29] Deléger, L., Grouin, C., Zweigenbaum, P., Extracting medication information from French clinical texts. Stud. Health Technol. Inform. 160 (2010), 949–953, 10.3233/978-1-60750-588-4-949.
30. [30] Ferreira, L., Teixeira, A., Cunha, J., Medical Information Extraction in European Portuguese, 2013, 10.4018/978-1-4666-3986-7.ch032.
31. [31] Carrero, F., Cortizo, J.C., Gomez, J.M., De Buenaga, M., In the development of a Spanish metamap. Proc. 17th ACM Conf. Inf. Knowl. Manag. ACM, 2008, 1465–1466.
32. [32] Carrero, F., Cortizo, J.C., Gomez, J.M., Building a Spanish MMTx by using automatic translation and biomedical ontologies. Intell. Data Eng. Autom. Learn, 2008, 346–353, 10.1007/978-3-540-88906-9-44.
33. [33] National Library of Medicine, UMLS® Reference Manual, 2009. < http://www.ncbi.nlm.nih.gov/books/NBK9676/>.
34. [34] Bodenreider, O., McCray, A.T., Exploring semantic groups through visual approaches. J. Biomed. Inform. 36 (2003), 414–432, 10.1016/j.jbi.2003.11.002.
35. [35] Wu, S.T., Liu, H., Li, D., Tao, C., Musen, M.A., Chute, C.G., et al. Unified Medical Language System term occurrences in clinical notes: a large-scale corpus analysis. J. Am. Med. Inform. Assoc. 19 (2012), e149–56, 10.1136/amiajnl-2011-000744.
36. [36] National Library of Medicine, MetaMap Data File Builder, (n.d.). < https://metamap.nlm.nih.gov/DataFileBuilder.shtml>.
37. [37] National Library of Medicine, UMLS Source Vocabulary Documentation, (n.d.). < https://www.nlm.nih.gov/research/umls/sourcereleasedocs/index.html>.
38. [38] Volk, M., Ripplinger, B.a., Vintar, S., Buitelaar, P., Raileanu, D., Sacaleanu, B., Semantic annotation for concept-based cross-language medical information retrieval. Int. J. Med. Inform. 67 (2002), 97–112, 10.1016/S1386-5056(02)00058-8.
39. [39] Markó, K., Schulz, S., Hahn, U., MorphoSaurus–design and evaluation of an interlingua-based, cross-language document retrieval engine for the medical domain. Methods Inf. Med. 44 (2005), 537–545.
40. [40] Divita, G., Tse, T., Roth, L., Failure analysis of MetaMap transfer (MMTx). Stud. Health Technol. Inform. 107 (2004), 763–767, 10.3233/978-1-60750-949-3-763.
41. [41] Rindflesch, T.C., Bean, C.a., Sneiderman, C.a., Argument identification for arterial branching predications asserted in cardiac catheterization reports. AMIA Annu. Symp. Proc., 2000, 704–708.
42. [42] Pratt, W., Yetisgen-Yildiz, M., A study of biomedical concept identification: MetaMap vs. people. AMIA Annu. Symp. Proc., 2003, 529–533 D030003464 [pii].