Identifying clinical terms in medical text using ontology-guided machine learning

JMIR Medical Informatics

Volumn 7, Issue 2, 2019, Pages

  Arbabi, Aryan ^a,b   Adams, David R ^c   Fidler, Sanja ^a   Brudno, Michael ^a,b  

^a UNIVERSITY OF TORONTO   (Canada)

^b HOSPITAL FOR SICK CHILDREN   (Canada)

^c NATIONAL HUMAN GENOME RESEARCH INSTITUTE   (United States)

Author keywords

Biomedical ontologies; Concept recognition; Human phenotype ontology; Machine learning; Medical text mining; Phenotyping

Indexed keywords

EID: 85099552240     PISSN: None     EISSN: 22919694     Source Type: Journal    
DOI: 10.2196/12596     Document Type: Article

References (40)

1. Simmons M, Singhal A, Lu Z. Text Mining for Precision Medicine: Bringing Structure to EHRs and Biomedical Literature to Understand Genes and Health. Adv Exp Med Biol 2016; 939:139-166 [FREE Full text] [doi: 10.1007/978-981-10-1503-8_7] [Medline: 27807747]
2. Jonnagaddala H. Mining Electronic Health Records to Guide and Support Clinical Decision Support Systems. In: Healthcare Ethics and Training: Concepts, Methodologies, Tools, and Applications. PA, USA: IGI Global; 2017:184-201.
3. Luo Y, Thompson WK, Herr TM, Zeng Z, Berendsen MA, Jonnalagadda SR, et al. Natural Language Processing for EHR-Based Pharmacovigilance: A Structured Review. Drug Saf 2017 Dec; 40(11):1075-1089. [doi: 10.1007/s40264-017-0558-6] [Medline: 28643174]
4. Gonzalez GH, Tahsin T, Goodale BC, Greene AC, Greene CS. Recent Advances and Emerging Applications in Text and Data Mining for Biomedical Discovery. Brief Bioinform 2016 Jan; 17(1):33-42 [FREE Full text] [doi: 10.1093/bib/bbv087] [Medline: 26420781]
5. Piñero J, Queralt-Rosinach N, Bravo A, Deu-Pons J, Bauer-Mehren A, Baron M, et al. DisGeNET: A discovery platform for the dynamical exploration of human diseases and their genes. Database (Oxford) 2015; 2015:bav028 [FREE Full text] [doi: 10.1093/database/bav028] [Medline: 25877637]
6. SNOMED International. URL:http://www.snomed.org/snomed-ct/five-step-briefing [accessed 2019-04-18] [WebCite Cache ID 77jn1Od9U]
7. Köhler S, Vasilevsky NA, Engelstad M, Foster E, McMurry J, Aymé S, et al. The Human Phenotype Ontology in 2017. Nucleic Acids Res 2017 Dec 04; 45(D1):D865-D876 [FREE Full text] [doi: 10.1093/nar/gkw1039] [Medline: 27899602]
8. Lochmüller H, Le Cam Y, Jonker AH, Lau LPI, Baynam G, Kaufmann P, et al. 'IRDiRC Recognized Resources': A new mechanism to support scientists to conduct efficient, high-quality research for rare diseases. Eur J Hum Genet 2017 Dec; 25(2):162-165 [FREE Full text] [doi: 10.1038/ejhg.2016.137] [Medline: 27782107]
9. Rehm HL, Berg JS, Brooks LD, Bustamante CD, Evans JP, Landrum MJ, ClinGen. ClinGen-the Clinical Genome Resource. N Engl J Med 2015 Dec 04; 372(23):2235-2242 [FREE Full text] [doi: 10.1056/NEJMsr1406261] [Medline: 26014595]
10. Jonquet C, Shah NH, Musen MA. The open biomedical annotator. Summit Transl Bioinform 2009 Mar 01; 2009:56-60 [FREE Full text] [Medline: 21347171]
11. Taboada M, Rodríguez H, Martínez D, Pardo M, Sobrido MJ. Automated semantic annotation of rare disease cases: A case study. Database (Oxford) 2014; 2014 [FREE Full text] [doi: 10.1093/database/bau045] [Medline: 24903515]
12. Aronson AR. Effective mapping of biomedical text to the UMLS Metathesaurus: The MetaMap program. Proc AMIA Symp 2001:17-21 [FREE Full text] [Medline: 11825149]
13. Savova GK, Masanz JJ, Ogren PV, Zheng J, Sohn S, Kipper-Schuler KC, et al. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): Architecture, component evaluation and applications. J Am Med Inform Assoc 2010; 17(5):507-513 [FREE Full text] [doi: 10.1136/jamia.2009.001560] [Medline: 20819853]
14. Groza T, Köhler S, Doelken S, Collier N, Oellrich A, Smedley D, et al. Automatic concept recognition using the human phenotype ontology reference and test suite corpora. Database (Oxford) 2015; 2015 [FREE Full text] [doi: 10.1093/database/bav005] [Medline: 25725061]
15. Lobo M, Lamurias A, Couto FM. Identifying Human Phenotype Terms by Combining Machine Learning and Validation Rules. Biomed Res Int 2017; 2017:8565739 [FREE Full text] [doi: 10.1155/2017/8565739] [Medline: 29250549]
16. Girdea M, Dumitriu S, Fiume M, Bowdin S, Boycott KM, Chénier S, et al. PhenoTips: Patient phenotyping software for clinical and research use. Hum Mutat 2013 Aug; 34(8):1057-1065. [doi: 10.1002/humu.22347] [Medline: 23636887]
17. Lample G. arXiv. 2016. Neural Architectures for Named Entity Recognition URL:https://arxiv.org/abs/1603.01360 [accessed 2019-04-24] [WebCite Cache ID 77sNQlmqS]
18. Huang Z, Xu W, Yu K. arXiv. 2015. Bidirectional LSTM-CRF Models for Sequence Tagging URL:https://arxiv.org/abs/1508.01991 [accessed 2019-04-24] [WebCite Cache ID 77sNfWP89]
19. Ma X, Hovy E. arXiv. 2016. End-to-End Sequence Labeling via Bi-Directional Lstm-Cnns-Crf URL:https://arxiv.org/abs/1603.01354 [accessed 2019-04-24] [WebCite Cache ID 77sNvEEZi]
20. Hochreiter S, Schmidhuber J. Long Short-Term Memory. Neural Computation 1997 Nov; 9(8):1735-1780. [doi: 10.1162/neco.1997.9.8.1735]
21. Lafferty J, McCallum A, Pereira FCN. University of Pennsylvania ScholarlyCommons. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data URL:https://repository.upenn.edu/cgi/viewcontent. cgi?article=1162 & context=cis_papers [accessed 2019-04-24]
22. Tjong Kim Sang EF, De Meulder F. Introduction to the CoNLL-Language-Independent Named Entity Recognition. 2003 Presented at: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL; 2003; Edmonton, Canada p. 142-147 URL:https://www.aclweb.org/anthology/W03-0419
23. Johnson AEW, Pollard TJ, Shen L, Lehman LWH, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data 2016 May 24; 3:160035 [FREE Full text] [doi: 10.1038/sdata.2016.35] [Medline: 27219127]
24. Glueck M, Naeini MP, Doshi-Velez F, Chevalier F, Khan A, Wigdor D, et al. PhenoLines: Phenotype Comparison Visualizations for Disease Subtyping via Topic Models. IEEE Trans Vis Comput Graph 2018 Dec; 24(1):371-381. [doi: 10.1109/TVCG.2017.2745118] [Medline: 28866570]
25. Habibi M, Weber L, Neves M, Wiegandt DL, Leser U. Deep learning with word embeddings improves biomedical named entity recognition. Bioinformatics 2017 Jul 15; 33(14):i37-i48 [FREE Full text] [doi: 10.1093/bioinformatics/btx228] [Medline: 28881963]
26. Vani A, Jernite Y, Jernite D. arXiv. 2017. Grounded Recurrent Neural Networks URL:https://arxiv.org/abs/1705.08557 [accessed 2019-04-24] [WebCite Cache ID 77sOcriI7]
27. Deng J, Ding N, Jia Y, Frome A, Murphy K, Bengio S, et al. Large-Scale Object Classification Using Label Relation Graphs. In: Computer Vision - ECCV 2014. NY, USA: Springer; 2014.
28. Vendrov I, Kiros R, Fidler S, Urtasun R. arXiv. 2015. Order-Embeddings of Images and Language URL:https://arxiv.org/abs/1511.06361 [accessed 2019-04-24] [WebCite Cache ID 77sPDXI71]
29. Neelakantan A, Roth B, McCallum A. arXiv. 2015. Compositional Vector Space Models for Knowledge Base Inference URL:https://arxiv.org/abs/1504.06662 [accessed 2019-04-24] [WebCite Cache ID 77sPQJhCH]
30. Nickel M, Kiela D. arXiv. 2017. Poincaré Embeddings for Learning Hierarchical Representations URL:https://arxiv.org/abs/1705.08039 [accessed 2019-04-24] [WebCite Cache ID 77sPb3fYf]
31. Bojanowski P, Grave E, Joulin A, Mikolov T. Enriching Word Vectors with Subword Information. Transactions of the Association for Computational Linguistics 2017 Dec; 5:135-146. [doi: 10.1162/tacl_a_00051]
32. Kim Y. arXiv. 2014. Convolutional Neural Networks for Sentence Classification URL:https://arxiv.org/abs/1408.5882 [accessed 2019-04-24] [WebCite Cache ID 77sPyeki6]
33. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. arXiv. 2017. Attention Is All You Need URL:https://arxiv.org/abs/1706.03762 [accessed 2019-04-24] [WebCite Cache ID 77sQBej4D]
34. Clevert AD, Unterthiner T, Hochreiter S. arXiv. 2015. Fast and Accurate Deep Network Learning by Exponential Linear Units (Elus) URL:https://arxiv.org/abs/1511.07289 [accessed 2019-04-24] [WebCite Cache ID 77sQPixhj]
35. Kingma DP, Ba J. arXiv. 2014. A Method for Stochastic Optimization URL:https://arxiv.org/abs/1412.6980 [accessed 2019-04-24] [WebCite Cache ID 77sQZGHQF]
36. Tifft CJ, Adams DR. The National Institutes of Health undiagnosed diseases program. Curr Opin Pediatr 2014 Dec; 26(6):626-633 [FREE Full text] [doi: 10.1097/MOP.0000000000000155] [Medline: 25313974]
37. Bodenreider O. The Unified Medical Language System (UMLS): Integrating biomedical terminology. Nucleic Acids Res 2004 Jan 01; 32(Database issue):D267-D270 [FREE Full text] [doi: 10.1093/nar/gkh061] [Medline: 14681409]
38. GitHub. Neural CR URL:https://github.com/ccmbioinfo/NeuralCR [accessed 2019-04-24] [WebCite Cache ID 77sLcntjU]
39. Kiros R, Zhu Y, Salakhutdinov R, Zemel RS, Torralba A, Urtasun R, et al. Skip-thought vectors. In: Advances in neural information processing systems. 2015 Presented at: Proceedings of the 28th International Conference on Neural Information Processing Systems Skip-Thought Vectors; December 07-12, 2015; Montreal, Canada p. 3302.
40. Devlin J, Chang MW, Lee K, Toutanova K. arXiv. 2018. BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding URL:https://arxiv.org/abs/1810.04805 [accessed 2019-04-24] [WebCite Cache ID 77sRFfJCW]