Formative evaluation of ontology learning methods for entity discovery by using existing ontologies as reference standards

Methods of Information in Medicine

Volumn 52, Issue 4, 2013, Pages 308-316

  Liu, Kaihong ^a   Mitchell, J K ^a   Chapman, W W ^b   Savova, G K ^c   Sioutos, N ^d   Rubin, D L ^e   Crowley, R S ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c BOSTON CHILDREN S HOSPITAL   (United States)

^d LOCKHEED MARTIN   (United States)

^e STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Learning algorithm; Natural language processing; Ontology enrichment; Ontology evaluation; Ontology learning from text; Statistical ontology; Statistical ontology learning method

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL ONTOLOGY; CONTROLLED VOCABULARY; ELECTRONIC MEDICAL RECORD; ELECTRONIC MEDICAL RECORD SYSTEM; EVALUATION STUDY; HOSPITAL INFORMATION SYSTEM; HUMAN; MEDICAL INFORMATICS; NATURAL LANGUAGE PROCESSING; NOMENCLATURE; PATHOLOGY; PENNSYLVANIA; RADIOLOGY INFORMATION SYSTEM; STANDARD; STANDARDS; UNITED STATES; UNIVERSITY HOSPITAL;

ACADEMIC MEDICAL CENTERS; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOLOGICAL ONTOLOGIES; HUMANS; MEDICAL INFORMATICS COMPUTING; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; NATURAL LANGUAGE PROCESSING; PATHOLOGY, SURGICAL; PATTERN RECOGNITION, AUTOMATED; PENNSYLVANIA; RADIOLOGY INFORMATION SYSTEMS; REFERENCE STANDARDS; TERMINOLOGY AS TOPIC; VOCABULARY, CONTROLLED;

MLCS; MLOWN;

EID: 84881234043     PISSN: 00261270     EISSN: None     Source Type: Journal    
DOI: 10.3414/ME12-01-0029     Document Type: Article

References (31)

1. Liu K, Hogan WR, Crowley RS. Natural Language Processing methods and systems for biomedical ontology learning. Journal of Biomedical Informatics 2011; 44 (1): 163-179.
2. Hearst MA. Automatic acquisition of hyponyms from large text corpora. Proceedings of the 12th Conference on Computational Linguistics; 1992; Nantes, France. 1992. pp 539-545.
3. Berland M, Charniak E. Finding parts in very large corpora. Proceedings of the 37th Conference on Computational Linguistics; 1999; College Park, MD. 1999. pp 57-64.
4. Harris ZS. Mathematical structures of language. New York, NY, USA: Krieger Pub Co; 1968.
5. Church KW, Hanks P. Word association norms, mutual information, and lexicography. Proceedings of 27th Annual Meeting of the Association for Computational Linguistics; 1989; Vancouver, BC, Canada. 1989. pp 76-83.
6. Agirre E, Ansa O, Hovy E, Martínez D. Enriching very large ontologies using the WWW. Proceedings of the Ontology Learning Workshop of the European Conference of AI (ECAI); 2000; Berlin, Germany. 2000.
7. Cimiano P, Pivk A, Schmidt-Thieme L, Stabb S. Learning taxonomic relations from heterogeneous sources of evidence. Proceeding of ECAI2004 Workshop on Ontology Learning and Evaluation, A Workshop at the 16th European Conference on Artificial Intelligence; 2004; Valencia, Spain. 2004.
8. Gliozzo A, Gioliano C, Strapparava C. Domain kernels for word sense disambiguation. Proceedings of the 43rd Annual Meeting of the ACL; 2005. 2005. pp 403-410.
9. Sánchez D, Moreno A. Web-scale taxonomy learning. Proceedings of the Workshop on Learning and Extending Lexical Ontologies by using Machine Learning; 2005. 2005.
10. Hartrumpf S. Extending knowledge and deepening linguistic processing for question answering. In: Peters C (ed). Results of the CLEF 2005 CrossLanguage System Evaluation Campaign, Working Notes for the CLEF 2005 Workshop 2005. pp 361-369.
11. Brewster C, Alani H, Dasmahapatra S, Wilks Y. Data Driven Ontology Evaluation. International Conference on Language Resources and Evaluation (LREC 2004); Lisbon, Portugal. May 2004. pp 24-30.
12. Navigli R, Velardi P, Cucchiarelli A, Neri F. Automatic Ontology Learning: Supporting a Per-Concept Evaluation by Domain Experts. Workshop on Ontology Learning and Population (ECAI 2004), Valencia, Spain. 2004.
13. Brank J, Mladeniæ D, Grobelnik M. Gold standard based ontology evaluation using intance assigment. Proceedings of the 4th Workshop on Evaluating Ontologies for the Web (EON2006); 2006; Edinboro, Scotland.; 2006.
14. Dellschaft K, Staab S. On how to perform a gold standard based evaluation of ontology learning. In: I. F. Cruz, S. Decker, D. Allemang, C. Preist, D. Schwabe, P. Mika, et al., editors. International Semantic Web Conference, Lecture Notes in Computer Science 2006. Springer, 2006. pp 228-241.
15. Meadche A, Staab S. Measuring similarity between ontology. Proceedings of the European Conference on Knowledge Acquisition and Management; 2002. pp 251-263.
16. Maynard D, Peters W, Li Y. Metrics for evaluation of ontology-based information extraction. Proceedings of the EON 2006 Workshop; 2006; Edinburgh, UK; 2006.
17. Liu K, Chapman WW, Savova G, Chute CG, Sioutos N, Crowley RS. Effectiveness of lexicosyntactic pattern matching for ontology enrich ment with clinical documents. Methods Inf Med 2010; 49 (6): 397-407.
18. Martins AL. Using grammar Iinference techniques in ontology learning. (Thesis) 2006.
19. National Cancer Institute Thesaurus (NCIT) 2010 (updated 2010; cited). Available from: http://ncit.nci.nih.gov/.
20. Mejino JLV, Rubin DL, Brinkley JF. FMA-RadLex: an application ontology of radiological anatomy derived from the Foundational Model of Anatomy reference ontology. Proceedings of the Annual Symposium of American Medical Informatics Association; Washington, DC. 2008. p 465.
21. MetaMap Technology Transfer (MMTX). 2012 (updated 2012; cited). Available from: http://ii.nlm.nih.gov/MMTx.shtml.
22. Dai M, Shah N, Xuan W, Musen M, Watson S, Athey B, et al. An Efficient Solution for Mapping Free Text to Ontology Terms. Mgrep. AMIA Summit on Translational Bioinformatics; San Francisco, CA 2008.
23. Zou Q, Chu W. Index Finder: A Knowledge-based Method for Indexing Clinical Texts (cited). Available from: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.13.841.
24. Church KW, Hanks P, editors. Word association norms, mutual information, and lexicography. Proceedings of 27th Annual Meeting of the ACL; 1989.
25. Lin D. Automatic retrieval and clustering of similar words. COLING '98 Proceedings of the 17th international conference on Computational linguistics; 1998; Montreal, Quebec, Canada.; 1998. pp 768-774.
26. Lin D. MINIPAR. 2012 (updated 2012; cited). Available from: http://webdocs.cs.ualberta.ca/~lindek/minipar.htm.
27. Clinical Text Analysis and Knowledge Extraction System (cTakes). 2012 (updated 2012; cited). Available from: http://ohnlp.sourceforge.net/cTAKES/.
28. Bodenreider O, Rindflesch TC, Burgun A. Unsupervised, corpus-based method for extending a biomedical terminology. Proceedings of the ACL-02 Workshop on Natural Language Processing in the Biomedical Domain; 2002. pp 53-60.
29. Kazamay Ji, Makinoz T, Ohta Y, Tsujiiy Ji. Tuning support vector machines for biomedical named entity recognition. Proceedings of the ACL workshop on Natural language processing in biomedicine; 2003. pp 1-8.
30. Blaschke C, Valencia A. Automatic ontology construction from the literature. Genome Inform 2002. pp 201-213.
31. Ontology Development and Information Extraction (ODIE) 2012 (updated 2012; cited). Available from: https://bmir-gforge.stanford.edu/gf/project/odie.