Evaluating ontology extraction tools using a comprehensive evaluation framework

Data and Knowledge Engineering

Volumn 69, Issue 10, 2010, Pages 1043-1061

  Park, Jinsoo ^a   Cho, Wonchin ^a   Rho, Sangkyu ^a  

^a Seoul National University   (South Korea)

Author keywords

Ontology; Ontology extraction tool; Tool evaluation

Indexed keywords

AUTOMATIC ONTOLOGY; COMPREHENSIVE EVALUATION; EDITING TOOLS; EVALUATION EXPERIMENTS; EVALUATION FRAMEWORK; EXTRACTION PROCESS; FUNCTIONAL PERFORMANCE; KEY COMPONENT; ONTOLOGY DEVELOPMENT; ONTOLOGY EXTRACTION; ONTOLOGY MERGING TOOLS; SPEED-UPS;

MERGING; SEMANTIC WEB;

ONTOLOGY;

EID: 77956344450     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2010.07.002     Document Type: Article

References (72)

1. M. Abulaish, and L. Dey Biological relation extraction and query answering from MEDLINE abstracts using ontology-based text mining Data & Knowledge Engineering 61 2007 228 262
2. T. Berners-Lee, J. Hendler, and O. Lassila The Semantic Web Scientific American 284 2001 34 43
3. G. Bisson, C. Nedellec, and D. Canamero Designing clustering methods for ontology building The Mo'K Workbench, In proceedings of the Workshop on Ontology Learning, 14th European Conference on Artificial Intelligence (ECAI), Berlin, Germany 2000 13 19
4. J. Brank, M. Grobelnik, and D. Mladenic A survey of ontology evaluation techniques Proceedings of the Conference on Data Mining and Data Warehouses 2005
5. J. Brank, D. Mladenic, and M. Grobelnik Gold standard based ontology evaluation using instance assignment Proceedings of the 4th International Workshop on Evaluation of Ontologies for the Web (EON) at the 15th International World Wide Web Conference, Edinburgh, UK 2006
6. C. Brewster, H. Alani, S. Dasmahapatra, and Y. Wilka Data driven ontology evaluation Proceedings of the Language Resources and Evaluation 2004
7. P. Buitelaar, D. Olejnik, and M. Sintek A protégé plug-in for ontology extraction from text based on linguistic analysis Proceedings of the 1st European Semantic Web Symposium (ESWS), Heraklion, Greece 2004
8. A. Burton-Jones, V. Storey, V. Sugumaran, and P. Ahluwalia A semiotic metrics suite for assessing the quality of ontologies Data & Knowledge Engineering 55 2005 84 102
9. G. Chaelandar, and B. Grau SVETLAN'-a system to classify words in context Proceedings of the Workshop on Ontology Learning, 14th European Conference on Artificial Intelligence (ECAI), Berlin, Germany 2000 19 24
10. S. Chidamber, and C. Kemerer A metrics suite for object-oriented design IEEE transactions on software engineering 20 6 1994 476 493
11. O. Corcho, M. Fernandez, and A. Gomez-Perez Methodologies, tools and languages for building ontologies. Where is the meeting point? Data & Knowledge Engineering 46 2003 41 64
12. H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan GATE: a framework and graphical development environment for robust NLP tools and applications Proceedings of the 40th Annual Meeting of the ACL 2002
13. W. Daelemans, and M. Reinberger Shallow text understanding for ontology content evaluation IEEE Intelligent Systems July/August 2004 76 77
14. M. Dahab, H. Hassan, and A. Refea TextOntoEx: automatic construction form natural English text Expert Systems with Applications 34 2 2008 1474 1480
15. S. Davis, and R. Bostrom Training end users: an experimental investigation of the roles of the computer interface and training methods MIS Quarterly 17 1 1993 61 85
16. T. Declerck A set of tools for intergrating linguistic and non-linguistic information Proceedings of the SAAKM workshop at ECAL 2002
17. K. Dellschaft, and S. Staab On how to perform a gold standard based evaluation of ontology learning Proceedings of the ISWC 2006
18. A. De Nicola, M. Missikoff, and R. Navigli A software engineering approach to ontology building Information Systems 34 2 2009 258 275
19. Y. Ding, and S. Foo Ontology research and development: part 1 - a review of ontology generation Journal of Information Science 28 5 2002 375 388
20. P. Drake Using the analytical hierarchy process in engineering education International Journal of Engineering Education 14 3 1998 191 196
21. A. Duineveld, R. Stoter, M. Weiden, B. Kenepa, and V. Benjamins Wonder tools? A comprehensive study of ontological engineering tool Proceedings of the 12th Workshop on Knowledge Acquisition 1999 Modeling and Management Nanff, Canada
22. J. Euzenat, and P. Shvaiko Ontology Matching 2007 Springer
23. D. Faure, and C. Nedellec Knowledge acquisition of predicate argument structures from technical texts using machine learning: the system ASIUM Proceedings of the 11th European Workshop (EKAK), LNAI 1621 1999 329 334
24. C. Fellbaum WordNet: an Electronic Lexical Database 1998 MIT Press
25. M. Fernandez, A. Gomez-Perez, N. Juristo, Methontology: from ontological art to ontological engineering, Workshop on Ontological Engineering. Spring Symposium Series (AAAI '97) Stanford, USA, 1997.
26. A. Gal, and G. Modica OntoBuilder: fully automatic extraction and consolidation of ontologies from Web sources Proceedings of the 20th International Conference on Data Engineering (ICDE) 2004
27. A. Gangemi, C. Catenacci, M. Ciaramita, and J. Lehmann A theoretical framework for ontology evaluation and validation Proceedings of the Semantic Web Applications and Perspectives (SWAP), 2nd Italian Semantic Web Workshop, Trento, Italy 2005
28. A. Gomez-Perez, and D. Manzano-Macho An overview of methods and tools for ontology learning form texts The Knowledge Engineering Review 19 3 2005 187 212
29. T. Gruber Towards principles for the design of ontologies used for knowledge sharing International Journal of Human-Computer Studies 43 4-5 1995 907 928
30. N. Guarino, and C. Welty An overview of OntoClean S. Staab, R. Studer, The Handbook on Ontologies 2004 151 172
31. M. Hearst Automatic acquisition of hyponyms from large text corpora Proceedings of the 14th International Conference on Computational linguistics 1992
32. A. Hevner, S. March, J. Park, and S. Ram Design science in information systems research MIS Quarterly 28 1 2004 75 106
33. J. Köhler, K. Munn, A. Rüegg, A. Skusa, and B. Smith Quality control for terms and definitions in ontologies and taxonomies BMC Bioinformatics 7 212 2006
34. P. Lambrix, and A. Edberg Evaluation of ontology merging tools in bioinformatics Proceedings of the Pacific Symposium on Biocomputing 8 2003 589 600
35. A. Maedche, and R. Volz The Text2Onto ontology extraction and maintenance environment Proceedings of the ICDM Workshop on Integrating Data Mining and Knowledge Management, San Jose, California, USA 2001
36. A. Maedche, S. Staab, Ontology learning, In Handbook on Ontologies, In S. Staab and R. Studer, eds., The Handbook on Ontologies. Springer, 2004, 173-190.
37. D. Maynard, A. Funk, and W. Peters SPRAT: a tool for automatic semantic pattern-based ontology population Proceedings of the International Conference for Digital Libraries and the Semantic Web, Trento, Italy 2009
38. T. Morita, N. Fukuta, N. Izumi, and T. Yamaguchi DODDLE-OWL: a domain ontology construction tool with OWL Lecture Notes in Computer Science 4185 2006 537 551
39. A. Murshed, R. Singh, Evaluation and ranking of ontology construction tools," Technical Report DIT-05-013, University of Trento, 2005.
40. R. Navigli, and P. Velardi Learning domain ontologies from document warehouses and dedicated web sites Computational Linguistics 30 2 2004 151 179
41. R. Navigli, P. Velardi, A. Cucchiarelli, and F. Neri Quantitative and qualitative evaluation of the OntoLearn ontology learning system Proceedings of the 20th International Conference on Computational Linguistics (COLING) 2004 1043 1050
42. J. Nielsen Usability Engineering 1993 Harcourt Brace Company
43. D. Norman, and S. Draper User centered system design - new perspectives on human-computer interaction Lawrence Erlbaum Associates 1986
44. N. Noy, and M. Musen The PROMPT suite: interactive tools for ontology merging and mapping International Journal of Human-Computer Studies 59 6 2003 983 1024
45. D. McGuinness, R. Fikes, J. Rice, and S. Wilder An environment for merging and testing large ontologies Proceedings of the Seventh International Conference on Principles of Knowledge Representation and Reasoning 2000 Breckenridge, CO USA 483 493
46. A. Orme, H. Yao, and L. Etzkorn Indicating ontology data quality, stability, and completeness throughout ontology evolution Journal of Software Maintenance and Evolution: Research and Practice 19 2007 49 75
47. J. Park Ontology Gordon B. Davis, The Blackwell Encyclopedia of Management Vol. VII 2005 Blackwell Publishing Cambridge, Massachusetts 233 236
48. H. Perera, and W. Costa Analytic hierarchy process for selection of ERP software for manufacturing companies Vision 12 4 2008 1 11
49. T. Saaty The Analytic Hierarchy Process 1980 McGraw-Hill NewYork
50. T. Saaty How to make a decision: the analytical hierarchy process Inferences 24 6 1994 19 43
51. D. Sanchez, and A. Moreno Learning non-taxonomic relationships from web documents for domain ontology construction Data & Knowledge Engineering 64 2008 600 623
52. M. Shamsfard, and A. Barforoush The state of the art in ontology learning: a framework for comparison The Knowledge Engineering Review 18 4 2003 293 316
53. B. Shneiderman Designing the User Interface: Strategies for Effective Human Computer Interaction 1992 Addison-Wesley
54. E. Simperl Reusing ontologies on the Semantic Web: a feasibility study Data & Knowledge Engineering 68 2009 905 925
55. Y. Sure, S. Staab, and R. Studer On-To-Knowledge methodology (OTKM) Steffen Staab, Rudi Studer, The Handbook on Ontologies 2004
56. C. Tao, and D. Embley Automatic hidden-web table interpretation, conceptualization, and semantic annotation Data & Knowledge Engineering 68 2009 683 703
57. P. Vossen Ontologies R. Mitkov, the Oxford Handbook of Computational Linguistics 2003 464 482
58. Y. Wand, and R. Weber On the deep structure of information systems Journal of Information Systems 5 1995 203 223
59. R. Weber Ontological issues in accounting information systems Researching Accounting as an Information System Discipline 2002 13 33
60. S. Wu, and W. Hsu SOAT: a semi-automatic domain ontology acquisition tool from Chinese corpus Proceedings of the 19th International Conference on Computational Linguistics, Taipei, Taiwan 2002 1 5
61. T. Yokoi The EDR electronic dictionary Communications of the ACM 38 11 1995 42 44
62. J. Yu, J. Thom, and A. Tam Requirements-oriented methodology for evaluating ontologies Information Systems 34 2009 766 791
63. DODDLE-OWL 〈 http://doddle-owl.sourceforge.net/
64. KAON 〈 http://kaon.semanticweb.org/
65. 3 〈 http://mr3.sourceforge.net/ 〉.
66. NeOn 〈 http://www.neon-project.org/ 〉.
67. OI-Modeler 〈 http://kaon.semanticweb.org/documentation/ 〉.
68. OntoBuilder 〈 http://iew3.technion.ac.il/OntoBuilder/ 〉.
69. OntoLT 〈 http://olp.dfki.de/OntoLT/OntoLT.htm/ 〉.
70. Protégé 〈 http://protege.stanford.edu/ 〉.
71. Text2Onto 〈 http://ontoware.org/projects/text2onto/ 〉.
72. xdoc2txt 〈 http://www31.ocn.ne.jp/~h-ishida/xdoc2txt.html/ 〉.