Benchmarking ontologies: Bigger or better?

PLoS Computational Biology

Volumn 7, Issue 1, 2011, Pages

  Yao, Lixia ^a,b   Divoli, Anna ^b,c   Mayzus, Ilya ^b,c   Evans, James A ^d   Rzhetsky, Andrey ^b,c,d  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c UNIVERSITY OF CHICAGO   (United States)

^d UNIVERSITY OF CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; METADATA; THESAURI;

BIOMEDICAL SCIENCE; DATA COLLECTION; DOMAIN REPRESENTATIONS; FORMAL REPRESENTATIONS; HIGH-THROUGHPUT DATA; INTERNAL CONSISTENCY; KNOWLEDGE DOMAINS; MEDICAL ONTOLOGY; ONTOLOGY'S; PROPERTY;

ONTOLOGY;

ACCURACY; ARTICLE; BIOMEDICINE; BOOK; DATA BASE; DATA MINING; INFORMATION PROCESSING; INTERNAL CONSISTENCY; KNOWLEDGE; METAPHYSICS; NOMENCLATURE; ONTOLOGY; TAXONOMY; INFORMATION RETRIEVAL;

INFORMATION STORAGE AND RETRIEVAL;

EID: 79551510490     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1001055     Document Type: Article

References (78)

1. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, et al. (2000) Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet 25: 25-29.
2. Lesniewski S, Srzednicki JTJ, Stachniak Z, eds (1988) S. Lesniewski's lecture notes in logic. Dordrecht/Boston: Kluwer Academic.
3. Minsky, M (1975) A framework for representing knowledge. In: Winston P.H., ed. The Psychology of Computer Vision. New York: McGraw-Hill. pp 211-277.
4. Gruber TR (1993) Towards Principles for the Design of Ontologies Used for Knowledge Sharing: Knowledge Systems Laboratory: Stanford University.
5. Smith CL, Eppig JT (2009) The Mammalian Phenotype Ontology: enabling robust annotation and comparative analysis. Wiley Interdiscip Rev Syst Biol Med 1: 390-399.
6. Bult CJ, Eppig JT, Kadin JA, Richardson JE, Blake JA (2008) The Mouse Genome Database (MGD): mouse biology and model systems. Nucleic Acids Res 36: D724-728.
7. Blake JA, Bult CJ, Eppig JT, Kadin JA, Richardson JE (2009) The Mouse Genome Database genotypes: phenotypes. Nucleic Acids Res 37: D712-719.
8. Karp PD (2000) An ontology for biological function based on molecular interactions. Bioinformatics 16: 269-285.
9. Schulz S, Suntisrivaraporn B, Baader F, Boeker M (2009) SNOMED reaching its adolescence: ontologists' and logicians' health check. Int J Med Inform 78(Suppl 1): S86-94.
10. Jurasinski G, Retzer V, Beierkuhnlein C (2009) Inventory, differentiation, and proportional diversity: a consistent terminology for quantifying species diversity. Oecologia 159: 15-26.
11. Rzhetsky A, Iossifov I, Loh JM, White KP (2006) Microparadigms: chains of collective reasoning in publications about molecular interactions. Proc Natl Acad Sci U S A 103: 4940-4945.
12. Yu J, Thom JA, Tam A (2009) Requirements-oriented methodology for evaluating ontologies. Inform Syst 34: 766-791.
13. Grüninger M, Fox M (1995) Methodology for the design and evaluation of ontologies. Montreal, Canada: Workshop on Basic Ontological Issues in Knowledge Sharing. IJCAI'95.
14. Gomez-Perez A (1996) Towards a framework to verify knowledge sharing technology. Expert Syst Appl 11: 519-529.
15. Sim I, Olasov B, Carini S (2004) An ontology of randomized controlled trials for evidence-based practice: content specification and evaluation using the competency decomposition method. J Biomed Inform 37: 108-119.
16. Hyun S, Shapiro JS, Melton G, Schlegel C, Stetson PD, et al. (2009) Iterative evaluation of the Health Level 7-Logical Observation Identifiers Names and Codes Clinical Document Ontology for representing clinical document names: a case report. J Am Med Inform Assoc 16: 395-399.
17. Park JC, Kim TE, Park J (2008) Monitoring the evolutionary aspect of the Gene Ontology to enhance predictability and usability. BMC Bioinformatics 9(Suppl.): S3.
18. Evermann J, Fang J (2010) Evaluating ontologies: Towards a cognitive measure of quality. Inf Syst 35: 391-403.
19. Gangemi A, Catenacci C, Ciaramita M, Lehmann J (2006) Modelling ontology evaluation and validation. Lect Notes Comput Sc 4011: 140-154.
20. Faatz A, Steinmetz R (2004) Ontology enrichment evaluation. Lect Notes Comput Sc 3257: 497-498.
21. York S (2004) Why Evaluate Ontology Technologies? Because It Works! In: AsunciGm-Pr, Walter D, Marie-Laure R, Nicola G, Natalya FN, eds. pp 74-81.
22. Sabou M, Wroe C, Goble C, Stuckenschmidt H (2005) Learning domain ontologies for semantic Web service descriptions. J Web Semant 3: 340-365.
23. Mädche A, Staab S (2002) Computing Similarity between Ontologies. Proceedings of the 13th International Conference on Knowledge Engineering and Knowledge Management, EKAW02. Berlin: Springer Verlag.
24. Mädche A (2002) Ontology learning for the semantic Web. Boston: Kluwer.
25. Cimiano P, Hotho A, Staab S (2005) Learning Concept Hierarchies from Text Corpora using Formal Concept Anaylsis. J Artif Intell Res 24: 305-339.
26. Dellschaft K, Staab S (2006) On How to Perform a Gold Standard Based Evaluation of Ontology Learning. In Proceedings of the 5th International Semantic Web Conference (ISWC'06). Springer. pp 228-241.
27. Kiritchenko S, Matwin S, Famili AF (2005) Functional annotation of genes using hierarchical text categorization. In: Proceedings of BioLINK SIG: Linking Literature, Information and Knowledge for Biology Detroit, MI.
28. Verspoor K, Cohn J, Mniszewski S, Joslyn C (2006) A categorization approach to automated ontological function annotation. Protein Sci 15: 1544-1549.
29. Hahn U, Schnattinger K (1998) Towards text knowledge engineering. In: Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence. Madison, Wisconsin, United States: American Association for Artificial Intelligence. pp 524-531.
30. Maynard D, Peters W, Li Y (2006) Metrics for Evaluation of Ontology-based Information Extraction. Edinburgh, Scotland: In: WWW 2006 Workshop on ''Evaluation of Ontologies for the Web'' (EON).
31. Brank J, Mladenić D, Grobelnik M (2006) Gold Standard Based Ontology Evaluation Using Instance Assignment. Edinburgh, UK: In: Proc of the EON 2006 Workshop.
32. Missikoff M, Navigli R, Velardi P (2002) The usable ontology: An environment for building and assessing a domain ontology. Sardinia, Italia, 2002: In: International Semantic Web Conference (ISWC).
33. Smith B (2006) From concepts to clinical reality: an essay on the benchmarking of biomedical terminologies. J Biomed Inform 39: 288-298.
34. Ceusters W, Smith B (2006) A realism-based approach to the evolution of biomedical ontologies. AMIA Annu Symp Proc. pp 121-125.
35. Navigli R, Velardi P (2004) Learning domain ontologies from document warehouses and dedicated web sites. Comput Linguist 30: 151-179.
36. Brewster C (2006) Ontology learning from text: Methods, evaluation and applications. Comput Linguist 32: 569-572.
37. Buitelaar P, Cimiano P, Magnini B (2005) Ontology learning from text: methods, evaluation and applications. Amsterdam; Washington DC: IOS Press.
38. Brewster C, Ciravegna F, Wilks Y (2002) User-centred ontology learning for knowledge management. Lect Notes Comp Sc 2553: 203-207.
39. Brewster C, Alani H, Dasmahapatra S, Wilks Y (2004) Data Driven Ontology Evaluation. Lisbon, Portugal: European Language Resources Association.
40. Zhang S, Bodenreider O (2006) Law and order: assessing and enforcing compliance with ontological modeling principles in the Foundational Model of Anatomy. Comput Biol Med 36: 674-693.
41. Verspoor K, Dvorkin D, Cohen KB, Hunter L (2009) Ontology quality assurance through analysis of term transformations. Bioinformatics 25: 177-184.
42. Rosse C, Kumar A, Mejino JL, Jr., Cook DL, Detwiler LT, et al. (2005) A strategy for improving and integrating biomedical ontologies. AMIA Annu Symp Proc. pp 639-643.
43. Guarino N, Welty CA (2002) Evaluating ontological decisions with OntoClean. Commun ACM 45: 61-65.
44. Go ́mez-Pe ́rez A, Fernández-López M, Corcho O (2004) Ontological engineering: with examples from the areas of knowledge management, e-commerce and the Semantic Web/Asunción Gómez-Pérez, Mariano Fernández-López, and Oscar Corcho. London; New York: Springer.
45. Sure Y, Domingue J (2006) The semantic web: research and applications: 3rd European Semantic Web Conference, ESWC 2006, Budva, Montenegro, June 11-14, 2006: proceedings. Berlin; New York: Springer.
46. Cook DL, Mejino JL, Rosse C (2004) The foundational model of anatomy: a template for the symbolic representation of multi-scale physiological functions. Conf Proc IEEE Eng Med Biol Soc 7: 5415-5418.
47. American Public Health Association. (1899) The Bertillon classification of causes of death. Lansing Mich. R. Smith print.
48. WHO (2010) International Classification of Diseases (ICD). Geneva, Switzerland: World Health Organization.
49. Lipscomb CE (2000) Medical Subject Headings (MeSH). Bull Med Libr Assoc 88: 265-266.
50. Rogers FB (1963) Medical subject headings. Bull Med Libr Assoc 51: 114-116.
51. McCray AT, Miller RA (1998) Making the conceptual connections: the Unified Medical Language System (UMLS) after a decade of research and development. J Am Med Inform Assoc 5: 129-130.
52. Bodenreider O (2008) Issues in mapping LOINC laboratory tests to SNOMED CT. AMIA Annu Symp Proc. pp 51-55.
53. McCray AT (2006) Conceptualizing the world: lessons from history. J Biomed Inform 39: 267-273.
54. Spencer LM, Spencer VN (1986) Spencer's current ophthalmic terminology & abbreviations: includes the classification of ophthalmic disorders, current ICD9 and CPT listings & over 2000 systematically abbreviated terms. OxnardCA (1200 W. Gonzales Rd., #200, Oxnard 93030): MedWorld Publications.
55. Brown SH, Miller RA, Camp HN, Guise DA, Walker HK (1999) Empirical derivation of an electronic clinically useful problem statement system. Ann Intern Med 131: 117-126.
56. Cornet R, de Keizer N (2008) Forty years of SNOMED: a literature review. BMC Med Inform Decis Mak 8(Suppl 1): S2.
57. Aronson AR, Lang FM (2010) An overview of MetaMap: historical perspective and recent advances. J Am Med Inform Assoc 17: 229-236.
58. Cohen KB, Palmer M, Hunter L (2008) Nominalization and alternations in biomedical language. PLoS One 3: e3158.
59. Aronson AR (2001) Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proc AMIA Symp. pp 17-21.
60. Aronson AR, Rindflesch TC (1997) Query expansion using the UMLS Metathesaurus. Proc AMIA Annu Fall Symp. pp 485-489.
61. Walden V (1996) Defining the UMLS Metathesaurus. J AHIMA 68: 38.
62. McCray AT (1991) Extending a natural language parser with UMLS knowledge. Proc Annu Symp Comput Appl Med Care. pp 194-198.
63. McCray AT, Aronson AR, Browne AC, Rindflesch TC, Razi A, et al. (1993) UMLS knowledge for biomedical language processing. Bull Med Libr Assoc 81: 184-194.
64. McCray AT, Razi AM, Bangalore AK, Browne AC, Stavri PZ (1996) The UMLS Knowledge Source Server: a versatile Internet-based research tool. Proc AMIA Annu Fall Symp. pp 164-168.
65. Toutanova K, Klein D, Manning CD, Singer Y (2003) Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network. In: Human Language Technology Conference (HLT-NAACL 2003). pp 252-259.
66. Toutanova K, Manning CD (2000) Enriching the Knowledge Sources Used in a Maximum Entropy Part-of-Speech Tagger. In: Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC-2000). pp 63-70.
67. Lin D, Pantel P (2002) Concept Discovery from Text. In: Proceedings of Conference on Computational Linguistics (COLING-02) Taipei, Taiwan. Pp 577-583.
68. Harris Z (1954) Distributional structure. Word 10: 146-162.
69. Firth JR (1957) A synopsis of linguistic theory 1930-1955. In: Studies in Linguistic Analysis: Oxford: Philological Society. pp 1-32.
70. Justeson JS, Katz SM (1991) Co-occurrences of antonymous adjectives and their contexts. Comput Linguist 17: 1-19.
71. Riloff E, Jones R (1999) Learning dictionaries for information extraction by multi-level bootstrapping. In: Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence. Orlando-Florida, United States: American Association for Artificial Intelligence. Pp 474-479.
72. Rodale JI (1986) The Synonym Finder; Laurence Urdang NL, ed. Grand Central Publishing.
73. Laird C (1999) Webster's New World Roget's A-Z Thesaurus; Agnes ME, ed. Webster's New World.
74. Kipfer BA (1993) 21st Century Synonym and Antonym Finder; Institute PL, ed. Dell Publishing.
75. Spooner A, Oxford University Press. (2007) The Oxford dictionary of synonyms and antonyms. Oxford/New York: Oxford University Press.
76. Devlin J (1987) A Dictionary of Synonyms and Antonyms; Fried J, editor. Warner Books, Inc.
77. Scholastic I (2001) Scholastic dictionary of synonyms, antonyms, and homonyms. New York: Scholastic Reference.
78. Miller G (1990) WordNet: an online lexical database. Int J Lexicogr 3: 235-312.