The effect of semantic relatedness measures on multi-label classification evaluation

CIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval

Volumn , Issue , 2010, Pages 303-310

  Nowak, Stefanie ^a   Llorente, Ainhoa ^b   Motta, Enrico ^b   Rüger, Stefan ^b  

^a FRAUNHOFER IDMT   (Germany)

^b OPEN UNIVERSITY   (United Kingdom)

Author keywords

Benchmark; Evaluation; Evaluation measures; Image Annotation; WordNet

Indexed keywords

BENCHMARK; EVALUATION; EVALUATION MEASURES; IMAGE ANNOTATION; WORDNET;

IMAGE ANALYSIS; SEARCH ENGINES; SEMANTIC WEB; SEMANTICS; WORLD WIDE WEB;

ONTOLOGY;

EID: 77955908470     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1816041.1816086     Document Type: Conference Paper

References (31)

1. S. Banerjee and T. Pedersen. Extended Gloss Overlaps as a Measure of Semantic Relatedness. In Proc. of the Int'l Conf. on Art. Int., 2003.
2. A. Budanitsky and G. Hirst. Evaluating WordNet-based Measures of Lexical Semantic Relatedness. Computat. Linguistics, 32(1):13-47, 2006.
3. R. Cilibrasi and P. Vitanyi. The Google similarity distance. IEEE Trans. on Knowledge and Data Engineering, 19(3):370-383, 2007.
4. J. Fan, Y. Gao, and H. Luo. Integrating concept ontology and multitask learning to achieve more effective classifier training for multilevel image annotation. IEEE Trans. on Image Proc., 17(3), 2008.
5. A. Freitas and A. de Carvalho. A tutorial on hierarchical classification with applications in bioinformatics. Intelligent Information Technologies: Concepts, Methodologies, Tools and Applications, 2007.
6. S. Godbole and S. Sarawagi. Discriminative Methods for Multi-labeled Classification. Advances in Knowledge Discovery and Data Mining, 2004.
7. J. Gracia and E. Mena. Web-based measure of semantic relatedness. In Proc. of the Int'l Conf. on Web Information Systems Engineering, 2008.
8. G. Hirst and D. St-Onge. Lexical chains as representations of context for the detection and correction of malapropisms. WordNet: A Lexical Database for English, 1998.
9. J. J. Jiang and D. W. Conrath. Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy. In Proc. of Int'l Conf. Research on Computational Linguistics, 1997.
10. Y. Jiang, C. Ngo, and S. Chang. Semantic context transfer across heterogeneous sources for domain adaptive video search. In Proc. of the ACM Intern. conf. on Multimedia, pages 155-164, 2009.
11. M. Kendall. A New Measure of Rank Correlation. Biometrika, 30:81-89, 1938.
12. A. Kolmogorov. On the empirical determination of a distribution law. Selected Works of A.N. Kolmogorov, 2:139-146, 1986.
13. C. Leacock and M. Chodorow. Combining Local Context and WordNet Similarity for Word Sense Identification. WordNet: A Lexical Reference System and its Application, 1998.
14. M. Lesk. Automatic sense disambiguation using machine readable dictionaries: how to tell a pine cone from an ice cream cone. In Proc. of the Int'l Conf. on Systems Documentation, pages 24-26, 1986.
15. D. Lin. An information-theoretic definition of similarity. In Proc. of the Int'l Conf. on Machine Learning, 1998.
16. C. Manning, P. Raghavan, and H. Schütze. An Introduction to Information Retrieval. Cambridge, UK: Cambridge University Press, 2009.
17. M. Marszalek and C. Schmid. Semantic hierarchies for visual object recognition. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
18. M. Melucci. On rank correlation in information retrieval evaluation. In ACM SIGIR Forum, volume 41, page 33. ACM, 2007.
19. D. Milne and I. Witten. An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. In Proc. of the AAAI Workshop on Wikipedia and AI, 2008.
20. S. Nowak and P. Dunker. A Consumer Photo Tagging Ontology: Concepts and Annotations. In THESEUS/ImageCLEF Pre-Workshop, 2009.
21. S. Nowak and P. Dunker. Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task. CLEF Working Notes, 2009.
22. S. Nowak and H. Lukashevich. Multilabel Classification Evaluation using Ontology Information. In Proc. of IRMLeS Workshop, ESWC, 2009.
23. S. Nowak, H. Lukashevich, P. Dunker, and S. Rüger. Performance Measures for Multilabel Classification - A Case Study in the Area of Image Classification. In ACM MIR, 2010.
24. S. Patwardhan. Incorporating Dictionary and Corpus Information into a Context Vector Measure of Semantic Relatedness. Master's thesis, University of Minnesota, 2003.
25. P. Resnik. Using Information Content to Evaluate Semantic Similarity in a Taxonomy. In Proc. of the Int'l Joint Conf. on Art. Int., pages 448-453, 1995.
26. A. Schreiber, B. Dubbeldam, J. Wielemaker, and B. Wielinga. Ontology-based photo annotation. IEEE Intelligent Systems, pages 66-74, 2001.
27. X. Shen, M. Boutell, J. Luo, and C. Brown. Multi-label machine learning and its application to semantic scene classification. In Intern. Symp. on Electr. Imaging, 2004.
28. M. Srikanth, J. Varner, M. Bowden, and D. Moldovan. Exploiting ontologies for automatic image annotation. In Proc. of the 28th ACM SIGIR conference, 2005.
29. G. Tsoumakas and I. Vlahavas. Random k-labelsets: An ensemble method for multilabel classification. In Proc. of Europ. Conf. on Machine Learning, 2007.
30. L. Wu, X. Hua, N. Yu, W. Ma, and S. Li. Flickr distance. In Proceedings of the sixteen ACM Intern. conference on Multimedia, 2008.
31. Z. Wu and M. Palmer. Verb semantics and lexical selection. In Proc. of the 32nd Annual Meeting of the Association for Computational Linguistics, 1994.