Requirements-oriented methodology for evaluating ontologies

Information Systems

Volumn 34, Issue 8, 2009, Pages 766-791

  Yu, Jonathan ^a   Thom, James A ^a   Tam, Audrey ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Browsing; Ontology evaluation; User studies; Wikipedia

Indexed keywords

HARDWARE; INFORMATION SYSTEMS;

BROWSING; EVALUATION ACTIVITY; EVALUATION MEASURES; ONTOLOGY EVALUATIONS; SUB-DOMAINS; TASK-BASED; USER STUDY; WIKIPEDIA;

ONTOLOGY;

EID: 68249112927     PISSN: 03064379     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.is.2009.04.002     Document Type: Article

References (34)

1. Baeza-Yates R., and Ribeiro-Neto B. Modern Information Retrieval (1999), ACM Press, Addison-Wesley
2. C. Brewster, H. Alani, S. Dasmahapatra, Y. Wilks, Data driven ontology evaluation, in: Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC), Lisbon, Portugal, 2004. European Language Resources Association.
3. Davidson E.J. Evaluation Methodology Basics (2005), Sage Publications, London, UK
4. deMarco T. Controlling Software Projects: Management, Measurement, and Estimates (1986), Prentice-Hall PTR, Upper Saddle River, NJ, USA
5. Dong J.S., Lee C.H., Lee H.B., Li Y.F., and Wang H. A combined approach to checking web ontologies. Proceedings of the International Conference on World Wide Web (2004), ACM Press 714-722
6. A. Gangemi, C. Catenacci, M. Ciaramita, J. Lehmann, Ontology evaluation and validation, Technical Report, Laboratory for Applied Ontology, 2005.
7. Gómez-Pérez A. Towards a framework to verify knowledge sharing technology. Expert Systems With Applications 11 4 (1996) 519-529
8. Gómez-Pérez A. Evaluation of ontologies. International Journal of Intelligent Systems 16 (2001) 391-409
9. Gruber T.R. A translation approach to portable ontology specifications. Knowledge Acquisition 5 2 (1993) 199-220
10. Gruber T.R. Toward principles for the design of ontologies used for knowledge sharing. International Journal Human-Computer Studies 43 5-6 (1995) 907-928
11. M. Grüninger, M. Fox, Methodology for the design and evaluation of ontologies, in: Workshop on Basic Ontological Issues in Knowledge Sharing, IJCAI'95, 1995.
12. N. Guarino, Some ontological principles for designing upper level lexical resources, in: Proceedings of the 1st International Conference on Lexical Resources and Evaluation (LREC), May 1998.
13. Guarino N. Towards a formal evaluation of ontology quality (in Why evaluate ontology technologies? Because they work!). IEEE Intelligent Systems 19 4 (2004) 74-81
14. Guarino N., and Welty C. Evaluating ontological decisions with ontoclean. Communications of ACM 45 2 (2002) 61-65
15. Haase P., Hotho A., Schmidt-Thieme L., and Sure Y. Collaborative and usage-driven evolution of personal ontologies. Proceedings of the 2nd European Semantic Web Conference, Lecture Notes in Computer Science vol. 3532 (2005), Springer, London, UK 486-499
16. Lethbridge T. Metrics for concept-oriented knowledge bases. Software Engineering and Knowledge Engineering 8 2 (1998) 161-188
17. Lozano-Tello A., and Gómez-Pérez A. OntoMetric: a method to choose the appropriate ontology. Journal of Database Management 15 2 (2004) 1-18
18. Maedche A., and Staab S. Measuring similarity between ontologies. Proceedings of the 13th International Conference on Knowledge Engineering and Knowledge Management (2002), Springer, London, UK 251-263
19. Marchionini G. Information Seeking in Electronic Environments (1995), Cambridge University Press, Cambridge
20. McGuinness D.L. Spinning the semantic web: bringing the world wide web to its full potential. Ontologies Come of Age (2002), MIT Press, Cambridge, MA 171-195 (Chapter 6)
21. Moeller K., and Paulish D. Software Metrics: A Practitioner's Guide to Improved Product Development (1993), IEEE Press, New York
22. Orme A., Yao H., and Etzkorn L. Coupling metrics for ontology-based systems. IEEE Software 23 2 (2006) 102-108
23. Saaty T. How to make a decision: the analytic hierarchy process. Interfaces 24 6 (1994) 19-43
24. Scriven M. Evaluation Thesaurus. fourth ed. (1991), Sage Publications, Newbury Park, CA
25. Sowa J. Knowledge Representation: Logical Philosophical and Computational Foundations (2000), Brooks Cole
26. S. Tartir, I. Arpinar, M. Moore, A. Sheth, B. Aleman-Meza, OntoQA: metric-based ontology quality analysis, in: Proceedings of the Workshop on Knowledge Acquisition from Distributed, Autonomous, Semantically Heterogeneous Data and Knowledge Sources at IEEE International Conference on Data Mining (ICDM), Texas, USA, November 2005, pp. 45-53.
27. Thompson R., and Croft W. Support for browsing in an intelligent text retrieval system. International Journal of Man-Machine Studies 30 6 (1989) 639-668
28. Welty C., and Guarino N. Supporting ontological analysis of taxonomic relationships. Data and Knowledge Engineering 39 1 (2001) 51-74
29. Wikipedia online editing guidelines for categories 〈http://en.wikipedia.org/wiki/Wikipedia:Category〉, Accessed January 2008.
30. Wikipedia guidelines for category proposals and implementations (original) 〈http://meta.wikimedia.org/wiki/Categorization_requirements〉, Accessed January 2008.
31. J. Yu, Requirements-oriented methodology for evaluating ontologies, Ph.D. Thesis, RMIT University, Melbourne, Australia, 2008.
32. J. Yu, J. Thom, A. Tam, Ontology evaluation: using Wikipedia categories for browsing, in: Proceedings of the 16th Conference on Information and Knowledge Management, ACM Press, 2007, pp. 223-232.
33. J. Yu, J.A. Thom, A. Tam, Evaluating ontology criteria for requirements in a geographic travel domain, in: Proceedings of International Conference on Ontologies, DataBases and Applications of Semantics, 2005.
34. Zhao Y., and Karypis G. Hierarchical clustering algorithms for document datasets. Data Mining and Knowledge Discovery 10 2 (2005) 141-168