Combining image captions and visual analysis for image concept classification

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2008, Pages 8-17

  Kliegr, Tomas ^a   Chandramouli, Krishna ^b   Nemrava, Jan ^a   Svatek, Vojtech ^a   Izquierdo, Ebroul ^b  

^a UNIVERSITY OF ECONOMICS   (Czech Republic)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION ALGORITHM; CONCEPT CLASSIFICATION; EXPERIMENTAL EVALUATION; IMAGE CAPTION; SEMANTIC CONCEPT; UNKNOWN ENTITIES; UNSUPERVISED CLASSIFICATION; VISUAL ANALYSIS; WORDNET;

ONTOLOGY; SEMANTICS;

DATA MINING;

EID: 84865688064     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1509212.1509214     Document Type: Conference Paper

References (29)

1. T. Adamek, N. O Connor, and N. Murphy. Region-based segmentation of images using syntactic visual features. WIAMIS'05: Workshop on Image Analysis for Multimedia Interactive Services, Montreux, Switzerland, 2005.
2. E. Agirre. Word Sense Disambiguation: Algorithms and applications. Springer, 2007.
3. S. Banerjee and T. Pedersen. Extended gloss overlaps as a measure of semantic relatedness. In Proceedings of the 18th International Joint Conference on Artificial Intelligence, Acapulco, 2003.
4. T. L. Berg, A. C. Berg, J. Edwards, and D. Forsyth. Who's in the picture? In Neural Information Processing Systems Conference, 2004.
5. S. Blohm and P. Cimiano. Using the web to reduce data sparseness in pattern-based information extraction. In PKDD, volume 4702 of Lecture Notes in Computer Science, pages 18-29. Springer, 2007.
6. A. Budanitsky and G. Hirst. Evaluating wordnet-based measures of lexical semantic relatedness. Computational Linguistics, 32(1):13-47, 2006.
7. K. Chandramouli. Image classification using self organising feature maps and particle swarm optimisation. In Doctoral Consortium of SMAP'07: Proceedings of 2nd International Workshop on Semantic Media Adaptation and Personalization, pages 212-216, 2007.
8. K. Chandramouli, T. Kliegr, J. Nemrava, V. Svátek, and E. Isquierdo. Query refinement and user relevance feedback for contextualized image retrieval. In VIE 08: Proceedings of the 5th International Conference on Visual Information Engineering, 2008. To appear.
9. P. Cimiano and J. Voelker. Text2onto - a framework for ontology learning and data-driven change discovery. In NLDB'05: Proceedings of the 10th International Conference on Applications of Natural Language to Information Systems, 2005.
10. H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. A framework and graphical development environment for robust NLP tools and applications. In ACL 2002, 2002.
11. H. Cunningham, D. Maynard, and V. Tablan. JAPE - a Java Annotation Patterns Engine (Second edition), Department of Computer Science, University of Sheffield, 2000. Technical report.
12. K. Deschacht and M.-F. Moens. Text analysis for automatic image annotation. In ACL'05: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 1000-1007, Prague, Czech Republic, June 2007. ACL.
13. J. R. Finkel, T. Grenager, and C. Manning. Incorporating non-local information into information extraction systems by gibbs sampling. In ACL '05: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, pages 363-370, Morristown, NJ, USA, 2005. ACL.
14. T. Gevers, F. Aldershoff, and A. W. Smeulders. Classification of images on the internet by visual and textual information. In Proceedings of SPIE Conference on Internet Imaging, pages 16-27, Dec. 1999.
15. M. Hearst. Automatic acquisition of hyponyms from large text corpora. In 14th International Conference on Computational Linguistics, pages 539-545, 1992.
16. T. Joachims. Text categorization with support vector machines: learning with many relevant features. In ECML-98: Proceedings of the 10th European Conference on Machine Learning, number 1398, pages 137-142, Chemnitz, DE, 1998. Springer Verlag, Heidelberg, DE.
17. J. Kazama and K. Torisawa. Exploiting Wikipedia as external knowledge for named entity recognition. In EMNLP-CoNLL'07: Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 698-707, 2007.
18. B. S. Manjunath, J.-R. Ohm, V. V. Vinod, and A. Yamada. Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on MPEG - 7, 11(6):703-715, June 2001.
19. G. T. Papadopoulos, K. Chandramouli, V. Mezaris, I. Kompatsiaris, E. Izquierdo, and M. Strintzis. A comparative study of classification techniques for knowledge-assisted image analysis. In WIAMIS'08: Proceedings of 9th International Workshop on Image Analysis for Multimedia Interactive Services, 2008.
20. G. T. Papadopoulos, V. Mezaris, I. Kompatsiaris, and M. G. Strintzis. Combining Global and Local Information for Knowledge-Assisted Image Analysis and Classification. EURASIP Journal on Advances in Signal Processing, 2007:1-15, 2007.
21. L. A. Ramshaw and M. P. Marcus. Text chunking using transformation-based learning. In ACL Third Workshop on Very Large Corpora, pages 82-94, 1995.
22. D. Ruta and B. Gabrys. An overview of classifier fusion methods. Computing and Information Systems, 7, 2000.
23. S. Satoh, Y. Nakamura, and T. Kanade. Name-It: Naming and detecting faces in news videos. IEEE MultiMedia, 6(1):22-35, - 1999.
24. R. Sinha and R. Mihalcea. Unsupervised graph-basedword sense disambiguation using measures of word semantic similarity. In ICSC '07: Proceedings of the International Conference on Semantic Computing, pages 363-369, Washington, DC, USA, 2007. IEEE Computer Society.
25. R. Snow, D. Jurafsky, and A. Ng. Learning syntactic patterns for automatic hypernym discovery. In Advances in Neural Information Processing Systems, number 17, pages 1297-1304, Cambridge, MA, 2005. MIT Press.
26. R. Snow, D. Jurafsky, and A. Ng. Semantic taxonomy induction from heterogenous evidence. In COLING/ACL 06, pages 801-808, Sydney, Australia, 2006. ACM.
27. F. M. Suchanek, G. Kasneci, and G. Weikum. Yago: A Core of Semantic Knowledge. In WWW 2007: 16th international World Wide Web conference, New York, NY, USA, 2007. ACM Press.
28. T. Westerveld. Image retrieval: Content versus context. In Content-Based Multimedia Information Access, RIAO, 2000.
29. W. E. Winkler and Y. Thibaudeau. An application of the fellegi-sunter model of record linkage to the 1990 u.s. decennial census. Technical report, U.S. Bureau of the Census, Washington, D.C., 1991. Statistical Research Report Series RR91/09.