Efficient image annotation for automatic sentence generation

MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

Volumn , Issue , 2012, Pages 549-558

  Ushiku, Yoshitaka ^a   Harada, Tatsuya ^b   Kuniyoshi, Yasuo ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

multi stack decoding; online learning; passive aggressive

Indexed keywords

DATA SETS; IMAGE ANNOTATION; IMAGE CONTENT; ON-LINE LEARNING METHODS; ONLINE LEARNING; PASSIVE-AGGRESSIVE; SEMANTIC KNOWLEDGE; STATE-OF-THE-ART PERFORMANCE;

IMAGE ANALYSIS; IMAGE RECOGNITION; SEMANTICS;

E-LEARNING;

EID: 84871392832     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2393347.2393424     Document Type: Conference Paper

References (36)

1. A. Aker and R. Gaizauskas. Generating image descriptions using dependency relational patterns. In ACL, 2010.
2. L. Bottou. Large-Scale Machine Learning with Stochastic Gradient Descent. In COMPSTAT, 2010.
3. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer. Online Passive-Aggressive Algorithms. JMLR, 7:551-585, 2006.
4. K. Crammer and D. D. Lee. Learning via Gaussian Herding. In NIPS, 2010.
5. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR, 2009.
6. G. Doddington. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics. In HLT, 2002.
7. A. Farhadi, M. Hejrati, M. A. Sadeghi, P. Young, C. Rashtchian, J. Hockenmaier, and D. Forsyth. Every Picture Tells a Story: Generating Sentences from Images. In ECCV, 2010.
8. Y. Feng and M. Lapata. How Many Words is a Picture Worth? Automatic Caption Generation for News Images. In ACL, 2010.
9. D. Grangier, F. Monay, and S. Bengio. A Discriminative Approach for the Retrieval of Images from Text Queries. In ECML, 2006.
10. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid. TagProp: Discriminative Metric Learning in Nearest Neighbor Models for Image Auto-Annotation. In ICCV, 2009.
11. J. Jeon, V. Lavrenko, and R. Manmatha. Automatic Image Annotation and Retrieval using Cross-Media Relevance Models Categories and Subject Descriptors. In ACM SIGIR, 2003.
12. G. Kulkarni, V. Premraj, S. Dhar, S. Li, Y. Choi, A. C. Berg, and T. L. Berg. Baby Talk: Understanding and Generating Image Descriptions. In CVPR, 2011.
13. S. Li, G. Kulkarni, T. L. Berg, A. C. Berg, and Y. Choi. Composing Simple Image Descriptions using Web-scale N-grams. In CoNLL, 2011.
14. Y. Lin, F. Lv, S. Zhu, M. Yang, T. Cour, K. Yu, L. Cao, and T. Huang. Large-scale Image Classification: Fast Feature Extraction and SVM Training. In CVPR, 2011.
15. N. Loeff and A. Farhadi. Scene Discovery by Matrix Factorization. In ECCV, 2008.
16. D. G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. IJCV, 60(2):91-110, 2004.
17. A. Makadia, V. Pavlovic, and S. Kumar. A New Baselines for Image Annotation. In ECCV, 2008.
18. H. Nakayama. Linear Distance Metric Learning for Large-scale Generic Image Recognition. PhD thesis, The University of Tokyo, 2011.
19. H. Nakayama, T. Harada, and Y. Kuniyoshi. Evaluation of dimensionality reduction methods for image auto-annotation. In BMVC, 2010.
20. T. Ojala, M. Pietikäinen, and D. Harwood. A comparative study of texture measures with classification based on feature distributions. Pattern Recognition, 29(1):51-59, 1996.
21. A. Oliva and A. Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. IJCV, 42(3):145-175, 2001.
22. V. Ordonez, G. Kulkarni, and T. L. Berg. Im2Text: Describing Images Using 1 Million Captioned Photographs. In NIPS, 2011.
23. N. Otsu and T. Kurita. A new scheme for practical flexible and intelligent vision systems. In IAPR Workshop on Computer Vision, 1988.
24. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu. BLEU: a Method for Automatic Evaluation of Machine Translation. In ACL, 2002.
25. F. Perronnin, J. Sánchez, and T. Mensink. Improving the Fisher Kernel for Large-Scale Image Classification. In ECCV, 2010.
26. M. A. Sadeghi and A. Farhadi. Recognition Using Visual Phrases. In CVPR, 2011.
27. G. Salton and C. S. Yang. On the specification of term values in automatic indexing. Journal of documentation, 29(4):351-372, 1973.
28. J. Sánchez and F. Perronnin. High-Dimensional Signature Compression for Large-Scale Image Classification. In CVPR, 2011.
29. S. Sarin, M. Fahrmair, M. Wagner, and W. Kameyama. Holistic Feature Extraction for Automatic Image Annotation. In MUE, 2011.
30. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: a large dataset for non-parametric object and scene recognition. IEEE TPAMI, 30(11):1958-70, 2008.
31. Y. Ushiku, T. Harada, and Y. Kuniyoshi. Automatic Sentence Generation from Images. In ACM MM, 2011.
32. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained Linear Coding for Image Classification. In CVPR, 2010.
33. X.-J. Wang, L. Zhang, M. Liu, Y. Li, and W.-Y. Ma. ARISTA - Image Search to Annotation on Billions of Web Photos. In CVPR, 2010.
34. J. Weston, S. Bengio, and N. Usunier. WSABIE: Scaling Up To Large Vocabulary Image Annotation. In IJCAI, 2011.
35. Y. Yang, C. L. Teo, H. Daumé III, and Y. Aloimonos. Corpus-Guided Sentence Generation of Natural Images. In EMNLP, 2011.
36. B. Z. Yao, X. Yang, L. Lin, M. W. Lee, and S.-C. Zhu. I2T: Image Parsing to Text Description. Proceedings of the IEEE, 98(8):1485-1508, 2010.