Holistic feature extraction for automatic image annotation

Proceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011

Volumn , Issue , 2011, Pages 59-66

  Sarin, Supheakmungkol ^a   Fahrmair, Michael ^a   Wagner, Matthias ^a   Kameyama, Wataru ^b  

^a DOCOMO EURO LABS   (Germany)

^b WASEDA UNIVERSITY   (Japan)

Author keywords

Automatic image annotation; Background; Holistic feature extraction; K nearest neighbours; Saliency regions

Indexed keywords

AUTOMATIC IMAGE ANNOTATION; BACKGROUND; HOLISTIC FEATURE EXTRACTION; K NEAREST NEIGHBOURS; SALIENCY REGIONS;

EXPERIMENTS; FEATURE EXTRACTION; IMAGE ANALYSIS;

IMAGE RETRIEVAL;

EID: 80052595697     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MUE.2011.22     Document Type: Conference Paper

References (46)

1. Gantz, J. F., Reinsel, D., Chute, C., Schlichting, W., Mcarthur, J., Minton, S., Xheneti, I., Toncheva, A. and Manfrediz, A.: The Expanding Digital Universe: A Forecast of Worldwide Information Growth Through 2010, IDC White Paper, (online), http://www.emc.com/collateral/analyst-reports/expanding- digital-idcwhite-paper.pdf (2007).
2. Flickr Photo Statistics, http://blog.flickr.net/en/2010/09/19/5000000000/ (2010).
3. Facebook Photo Statistics, http://blog.facebook.com/blog.php?post= 206178097130 (2010).
4. Guillaumin, M., Mensink, T., Verbeek, J. and Schmid, C.: TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation, International Conference on Computer Vision (ICCV) 2009, pp. 309-316, 2009
5. Deng, Y., Manjunath, B. and Shin, H.: Color image segmentation, CVPR, Published by the IEEE Computer Society, p. 2446 (1999).
6. Shi, J. and Malik, J.: Normalized cuts and image segmentation, Pattern Analysis and Machine Intelligence, IEEE Transactions on, Vol. 22, No. 8, pp. 888-905 (2002).
7. Grady, L.: Random walks for image segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1768-1783 (2006). (Pubitemid 46405425)
8. Zahn, C.: Graph-theoretical methods for detecting and describing gestalt clusters, Computers, IEEE Transactions on, Vol. 100, No. 1, pp. 68-86 (2006).
9. Grady, L. and Schwartz, E.: Isoperimetric graph partitioning for image segmentation, Pattern Analysis and Machine Intelligence, IEEE Transactions on, Vol. 28, No. 3, pp. 469-475 (2006).
10. Laaksonen, J., Koskela, M. and Oja, E.: Content-Based Image Retrieval Using Self-Organizing Maps, VISUAL, pp. 541-548 (1999).
11. Meghini, C., Sebastiani, F. and Straccia, U.: A model of multimedia information retrieval, J. ACM, Vol. 48, pp. 909-970 (online), http://doi.acm.org/10.1145/502102.502103 (2001).
12. Schettini, R., CIOCCA, G., Zuffi, S., Tecnologie, I. and Multimediali, I.: A Survey Of Methods For Colour Image Indexing And Retrieval In Image Databases, In Color Imaging Science: Exploiting Digital, Media, John Wiley, pp. 9-1 (2001).
13. Ko, B., Lee, H.-S. and Byun, H.: Image retrieval using flexible image subblocks, Proceedings of the 2000 ACM symposium on Applied computing - Volume 2, SAC '00, New York, NY, USA, ACM, pp. 574-578 (online), http://doi.acm.org/10. 1145/338407.338502 (2000).
14. Shyu, M.-L., Chen, S.-C., Chen, M., Zhang, C. and Sarinnapakorn, K.: Image database retrieval utilizing affinity relationships, Proceedings of the 1st ACM international workshop on Multimedia databases, MMDB '03, New York, NY, USA, ACM, pp. 78-85 (online), http://doi.acm.org/10.1145/951676.951691 (2003). (Pubitemid 40682325)
15. Zhao, R. and Grosky, W.: From Features to Semantics: Some Preliminary Results, p. TAS3 (2000).
16. Tsai, C.-F., McGarry, K. and Tait, J.: Image classification using hybrid neural networks, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, SIGIR '03, New York, NY, USA, ACM, pp. 431-432 (online), http://doi.acm.org/10.1145/860435. 860536 (2003).
17. Monay, F. and Gatica-Perez, D.: On image auto-annotation with latent space models, MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia, New York, NY, USA, ACM, pp. 275-278 (online), http://doi.acm.org/10.1145/957013.957070 (2003).
18. Itti, L., Koch, C. and Niebur, E.: A Model of Saliency-Based Visual Attention for Rapid Scene Analysis, IEEE Trans. Pattern Anal. Mach. Intell., Vol. 20, No. 11, pp. 1254-1259 (online), http://dx.doi.org/10.1109/34.730558 (1998). (Pubitemid 128742001)
19. Judd, T., Ehinger, K., Durand, F. and Torralba, A.: Learning to predict where humans look, Computer Vision, 2009 IEEE 12th International Conference on, IEEE, pp. 2106-2113 (2010).
20. Achanta, R., Hemami, S., Estrada, F. and S?sstrunk, S.: Frequencytuned Salient Region Detection, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), (online), http://www.cvpr2009.org/ (2009).
21. Hou, X. and Zhang, L.: Saliency Detection: A Spectral Residual Approach, Proc. IEEE Conference on Computer Vision and Pattern Recognition CVPR '07, pp. 1-8 (online), 10.1109/CVPR.2007.383267 (2007). (Pubitemid 47533873)
22. Ameesh Makadia, Vladimir Pavlovic and Sanjiv Kumar: Baseline for Image Annotation, IJCV, Vol 90, Number 1, 88-105, DOI: 10.1007/s11263-010-0338-6.
23. Van De Sande, K., Gevers, T. and Snoek, C.: Evaluating color descriptors for object and scene recognition, Pattern Analysis and Machine Intelligence, IEEE Transactions on, Vol. 32, No. 9, pp. 1582-1596 (2010).
24. Oliva, A. and Torralba, A.: Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope, International Journal of Computer Vision, Vol. 42, No. 3, pp. 145-175 (online), http://dx.doi.org/10.1023/A: 1011139631724 (2001). (Pubitemid 32680801)
25. Friedman, A.: Framing pictures: The role of knowledge in automatized encoding and memory for gist, Journal of Experimental Psychology: General, Vol. 108, pp. 316-355 (1979).
26. Potter, M. C.: Short-term conceptual memory for pictures, Journal of Experimental Psychology: Human Learning and Memory 2, pp. 509-522 (1976).
27. Lowe, D.: Distinctive image features from scale-invariant keypoints, International journal of computer vision, Vol. 60, No. 2, pp. 91-110 (2004).
28. Van de Weijer, J., Gevers, T. and Bagdanov, A.: Boosting color saliency in image feature detection, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 150-156 (2006). (Pubitemid 46395313)
29. Bosch, A., Zisserman, A. and Muoz, X.: Scene classification using a hybrid generative/discriminative approach, Pattern Analysis and Machine Intelligence, IEEE Transactions on, Vol. 30, No. 4, pp. 712-727 (2008). (Pubitemid 351559723)
30. Abdel-Hakim, A. and Farag, A.: CSIFT: A SIFT descriptor with color invariant characteristics, Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, Vol. 2, IEEE, pp. 1978-1983 (2006). (Pubitemid 44931558)
31. Feng, S., Manmatha, R. and Lavrenko, V.: Multiple Bernoulli Relevance Models for Image and Video Annotation, CVPR (2), pp. 1002-1009 (2004).
32. Duygulu, P., Barnard, K., Freitas, J. F. G. d. and Forsyth, D. A.: Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary, ECCV '02: Proceedings of the 7th European Conference on Computer Vision-Part IV, London, UK, Springer-Verlag, pp. 97-112 (2002).
33. von Ahn, L. and Dabbish, L.: Labeling images with a computer game, CHI '04: Proceedings of the SIGCHI conference on Human factors in computing systems, New York, NY, USA, ACM, pp. 319-326 (online), http://doi.acm.org/10.1145/ 985692.985733 (2004).
34. Grangier, D. and Bengio, S.: A Discriminative Kernel-Based Approach to Rank Images from Text Queries, IEEE Trans. Pattern Anal. Mach. Intell., Vol. 30, pp. 1371-1384 (online), 10.1109/TPAMI.2007.70791 (2008).
35. Kok-Meng Ong, Supheakmungkol Sarin, and Wataru Kameyama. Affective and Holistic approach at TRECVID 2010 Task - Semantic Indexing (SIN). In Working Notes of TRECVID, 2010.
36. Supheakmungkol Sarin and Wataru Kameyama. Joint equal contribution of global and local features for image annotation. In CLEF Workshop, 2009.
37. Supheakmungkol Sarin and Wataru Kameyama. Holistic image features extraction for better image annotation. In IEICE General Conference, Sendai City, Miyagi, Japan, March 2010.
38. David Grangier and Samy Bengio. A discriminative kernel-based approach to rank images from text queries. IEEE Trans. Pattern Anal. Mach. Intell., 30:1371-1384, August, 2008.
39. Tomer Hertz, Aharon Bar-Hillel, and Daphna Weinshall. Learning distance functions for image retrieval. In Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition, CVPR'04, pages 570-577, Washington, DC, USA, 2004. IEEE Computer Society.
40. Kobus Barnard, Pinar Duygulu, David Forsyth, Nando de Freitas, David M. Blei, and Michael I. Jordan. Matching words and pictures. J. Mach. Learn. Res., 3:1107-1135, 2003.
41. Florent Monay and Daniel Gatica-Perez. Plsa-based image autoannotation: constraining the latent space. In MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia, pages 348{351, New York,NY, USA, 2004. ACM (Pubitemid 40211780)
42. K. Grauman and T. Darrell. Pyramid match kernels: Discriminative classification with sets of image features. In Proc. ICCV, 2005.
43. C. Wallraven, B. Caputo, and A. Graf. Recognition with local features: the kernel recipe. In Proc. ICCV, volume 1, pages 257-264, 2003.
44. J. Willamowski, D. Arregui, G. Csurka, C. R. Dance, and L. Fan. Categorizing nine visual classes using local appearance descriptors. In ICPR Workshop on Learning for Adaptable Visual Systems, 2004.
45. Svetlana Lazebnik, Cordelia Schmid, Jean Ponce, Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.2169-2178, June 17-22, 2006 (Pubitemid 44931582)
46. Guillaumin Matthieu: Exploiting Multimodal Data for Image Understanding, Ph.D. Thesis, Universite de Grenoble, France, 2010