A new method for evaluating automatically learned terminological taxonomies

Proceedings of the 8th International Conference on Language Resources and Evaluation, LREC 2012

Volumn , Issue , 2012, Pages 1498-1504

  Velardi, Paola ^a   Navigli, Roberto ^a   Faralli, Stefano ^a   Martinez, Juana Ruiz ^b  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b Departamento de Matemática Aplicada   (Spain)

Author keywords

Gold standard evaluation; Hierarchical cluster; Taxonomy learning

Indexed keywords

GOLD; HIERARCHICAL SYSTEMS;

CLUSTERINGS; COMPLEX PROBLEMS; GOLD STANDARDS; HIERARCHICAL CLUSTERS; TAXONOMY LEARNING; TWO-HIERARCHY;

TAXONOMIES;

EID: 85021660180     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. J. Brank, D. Mladenic, and M. Grobelnik. 2006. Gold standard based ontology evaluation using instance assignment. In Proc. Fourth Workshop Evaluating Ontologies for Web EON 2006.
2. C. Fellbaum, editor. 1998. WordNet: An Electronic Database. MIT Press, Cambridge, MA.
3. E.B. Fowlkes and C.L. Mallows. 1983. A method for comparing two hierarchical clusterings. In Journal of the American Statistical Association, volume 78, pages 553-569.
4. N. Guarino and C.Welty. 2002. Evaluating ontological decisions with ontoclean. In Communications of the ACM, volume 45, pages 61-65.
5. M.A. Hearst. 1992. Automatic acquisition of hyponyms from large text corpora. In Proc. of COLING, pages 539-545.
6. Z. Kozareva and E. Hovy. 2010. A semi-supervised method to learn and construct taxonomies using the web. In Proceedings of Empirical Methods in Natural Language Processing (EMNLP), pages 1110-1118, Cambridge, MA, October.
7. A. Maedche, V. Pekar, and S. Staab. 2002. Ontology learning part one: On discovering taxonomic relations from the web. In Proceedings of Web Intelligence, pages 301-322.
8. L. C. Morey and A. Agresti. 1981. An adjustment to the rand statistic for chance agreement. In The Classification Society Bulletin, volume 5, pages 9-10.
9. R. Navigli and P. Velardi. 2010. Learning Word-Class Lattices for definition and hypernym extraction. In Proceedings of ACL, pages 1318-1327, Uppsala, Sweden.
10. R. Navigli, P. Velardi, and S. Faralli. 2011. A graphbased algorithm for inducing lexical taxonomies from scratch. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence, pages 1872-1877, Barcelona, Spain.
11. W. M. Rand. 1971. Objective criteria for the evaluation of clustering methods. In Journal of the American Statistical Association, pages 66(336):846-850.
12. R. Snow, D. Jurafsky, and A. Ng. 2006. Semantic taxonomy induction from heterogeneous evidence. In Proc. of COLING-ACL, pages 801-808.
13. P. Velardi, S. Faralli, and R. Navigli. 2012. Ontolearn Reloaded: A graph-based algorithm for taxonomy induction. Submitted to Computational Linguistics.
14. J. Volker, J. Vrandecic, J. Sure, and A. Hotho. 2010. Aeon-an approach to the automatic evaluation of ontologies. In Journal of Applied Ontology, volume 3, pages 41-62
15. S. Wagner and D. Wagner. 2007. Comparing clusterings-an overview. Analysis, 4769:1-19.
16. H. Yang and J. Callan. 2009. A metric-based framework for automatic taxonomy induction. In Proceedings of ACL, pages 271-279, Stroudsburg, USA.
17. E. Zavitsanos, G. Paliouras, and G. A. Vouros. 2011. Gold standard evaluation of ontology learning methods through ontology transformation and alignment. In IEEE Transactions on Knowledge and Data Engineering (TKDE), volume 23, pages 1635-1648.