Evaluating the performance in automatic image annotation: Example case by adaptive fusion of global image features

Signal Processing: Image Communication

Volumn 22, Issue 6, 2007, Pages 557-568

  Viitaniemi, Ville ^a   Laaksonen, Jorma ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Automatic image annotation; Global image features; Mutual information; Performance evaluation; Self organising map

Indexed keywords

AUTOMATIC IMAGE ANNOTATION; GLOBAL IMAGE FEATURES; MUTUAL INFORMATION; PERFORMANCE EVALUATION;

IMAGE COMMUNICATION SYSTEMS; SELF ORGANIZING MAPS; SIGNAL PROCESSING; STATISTICS;

IMAGE ANALYSIS;

EID: 34447645656     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2007.05.003     Document Type: Article

References (26)

1. Barnard K., Duygulu P., de Freitas N., Forsyth D., Blei D., and Jordan M.I. Matching words and pictures. J. Mach. Learn. Res. Spec. Issue Mach. Learn. Methods for Text and Images 3 (2003) 1107-1135
2. Carneiro G., and Vasconcelos N. Formulating semantic image annotation as supervised learning problem. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2005) 163-168
3. Celebi E., and Alpkocak A. Combining textual and visual clusters for semantic image retrieval and auto-annotation. Proceedings of the Second European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies (EWIMT 2005), London, UK (2005) 219-225
4. Duygulu P., Barnard K., de Freitas N., and Forsyth D. Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. Proceedings of the Seventh European Conference on Computer Vision (2002) IV:97-IV:112
5. M. Everingham, A. Zisserman, C. Williams, L.V. Gool, The Pascal visual object classes challenge 2006 (VOC2006) results, Technical Report, 2006, Available on-line at: 〈http://www.pascal-network.org/〉.
6. Fan J., Gao Y., Luo H., and Xu G. Automatic image annotation by using concept-sensitive salient objects for image content representation. Proceedings of the 27th Annual International Conference on Research and Development in Information Retrieval, Sheffield, UK (2004) 361-368
7. Feng S.L., Manmatha R., and Lavrenko V. Multiple Bernoulli relevance models for image and video annotation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) vol. 2 (2004) 1002-1009
8. Grangier D., and Bengio S. A neural network to retrieve images from text queries. Proceedings of the 16th International Conference on Artificial Neural Networks (ICANN 2006) vol. 2 (2006), Springer, Berlin, Athens, Greece 35-44
9. ISO/IEC, Information technology-multimedia content description interface-part 3: visual, 15938-3:2002(E), 2002.
10. Jeon J., Lavrenko V., and Manmatha R. Automatic image annotation and retrieval using cross-media relevance models. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Toronto, Canada (2003) 119-126
11. Jeon J., and Manmatha R. Using maximum entropy for automatic image annotation. Proceedings of the Third International Conference on Image and Video Retrieval (2004) 24-32
12. Jin R., Chai J.Y., and Si L. Effective automatic image annotation via a coherent language model and active learning. Proceedings of the 12th Annual ACM International Conference on Multimedia (2004)
13. T. Kohonen, Self-Organizing Maps, third ed., Springer Series in Information Sciences, vol. 30, Springer, Berlin, 2001.
14. P. Koikkalainen, E. Oja, Self-organizing hierarchical feature maps, in: Proceedings of the International Joint Conference on Neural Networks, vol. II, San Diego, CA, USA, 1990, pp. 279-284.
15. Laaksonen J., Koskela M., and Oja E. PicSOM-self-organizing image retrieval with MPEG-7 content descriptions. IEEE Trans. Neural Networks Spec. Issue Intell. Multimedia Process. 13 4 (2002) 841-853
16. Lavrenko V., Manmatha R., and Jeon J. A model for learning the semantics of pictures. Proceedings of the 17th Annual Conference on Neural Information Processing Systems vol. 16 (2003) 553-560
17. Metzler D., and Manmatha R. An inference network approach to image retrieval. Proceedings of the International Conference on Image and Video Retrieval (CIVR 2004) (2004) 42-50
18. Mori Y., Takahashi H., and Oka R. Image-to-word transformation based on dividing and vector quantizing images with words. Proceedings of the First International Workshop on Multimedia Intelligent Storage and Retrieval Management (1999)
19. Müller H., Marchand-Maillet S., and Pun T. The truth about Corel-evaluation in image retrieval. Proceedings of International Conference on Image and Video Retrieval (2002) 38-49
20. Qi X., and Han Y. Incorporating multiple SVMs for automatic image annotation. Pattern Recognition 40 (2007) 728-741
21. Srikanth M., Varner J., Bowden M., and Moldovan D. Exploiting ontologies for automatic image annotation. Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (2005) 552-558
22. Tang J., Hare J.S., and Lewis P.H. Image auto-annotation using a statistical model with salient regions. Proceedings of IEEE International Conference on Multimedia and Expo (ICME), Toronto, Canada (2006)
23. Viitaniemi V., and Laaksonen J. Keyword-detection approach to automatic image annotation. Proceedings of the Second European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies (EWIMT 2005), London, UK (2005) 15-22
24. Viitaniemi V., and Laaksonen J. Use of image regions in context-adaptive image classification. In: Avrithis Y., Staab S., and O'Connor N. (Eds). Proceedings of the First International Conference on Semantic and Digital Media Technologies (SAMT 2006), Athens, Greece, Lecture Notes in Computer Science (2006), Springer, Berlin 169-183
25. Viitaniemi V., and Laaksonen J. Evaluating performance of automatic image annotation: example case by fusing global image features. Proceedings of the Fifth International Workshop on Content-Based Multimedia Indexing (CBMI 2007), Bordeaux, France (2007)
26. Yavlinsky A., Schofield E., and Rüger S. Automated image annotation using global features and robust nonparametric density estimation. Proceedings of the International Conference on Image and Video Retrieval, Singapore (2005) 507-517