Generating image descriptions using semantic similarities in the output space

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

Volumn , Issue , 2013, Pages 288-293

  Verma, Yashaswi ^a   Gupta, Ankush ^a   Mannem, Prashanth ^a   Jawahar, C V ^a  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Image Description; Semantic Similarity

Indexed keywords

IMAGE DESCRIPTIONS; OBJECTIVE FUNCTIONS; PARAMETER LEARNING; PHRASE PREDICTION; RELEVANCE PREDICTION; SEMANTIC SIMILARITY; SOURCES OF INFORMATIONS; STRUCTURED PREDICTION;

MATHEMATICAL MODELS; PATTERN RECOGNITION;

SEMANTICS;

EID: 84884963254     PISSN: 21607508     EISSN: 21607516     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2013.50     Document Type: Conference Paper

References (25)

1. M.-C. de Marneffe and C. D. Manning. The stanford typed dependencies representation. In COLING Workshop on Cross-framework and Cross-domain Parser Evaluation, 2008.
2. A. Farhadi, M. Hejrati, A. Sadeghi, P. Young, C. Rashtchian, J. Hockenmaier, and D. Forsyth. Every picture tells a story: Generating sentences for images. In ECCV, 2010.
3. C. Fellbaum. Wordnet: An electronic lexical database. Cambridge, MA: MIT Press, 1998.
4. S. L. Feng, R. Manmatha, and V. Lavrenko. Multiple bernoulli relevance models for image and video annotation. In CVPR, 2004.
5. A. Gatt and E. Reiter. Simplenlg: A realisation engine for practical applications. In ENLG, 2009.
6. A. Gupta, Y. Verma, and C. V. Jawahar. Choosing linguistics over vision to describe images. In AAAI, 2012.
7. J. J. Jiang and D. W. Conrath. Semantic similarity based on corpus statistics and lexical taxonomy. In ICRCL, 1997.
8. G. Kulkarni, V. Premraj, S. Dhar, S. Li, Y. Choi, A. C. Berg, and T. L. Berg. Baby talk: Understanding and generating simple image descriptions. In CVPR, 2011.
9. P. Kuznetsova, V. Ordonez, A. C. Berg, T. L. Berg, and Y. Choi. Collective generation of natural image descriptions. In ACL, 2012.
10. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, 2006.
11. J. Li. A mutual semantic endorsement approach to image retrieval and context provision. In MIR, 2005.
12. S. Li, G. Kulkarni, T. L. Berg, A. C. Berg, and Y. Choi. Composing simple image descriptions using web-scale n-grams. In CoNLL, 2011.
13. C.-Y. Lin and E. Hovy. Automatic evaluation of summaries using n-gram co-occurrence statistics. In NAACLHLT, 2003.
14. D. G. Lowe. Distinctive image features from scale-invariant keypoints. In IJCV, 2004.
15. M. Mitchell, J. Dodge, A. Goyal, K. Yamaguchi, K. Sratos, X. Han, A. Mensch, A. C. Berg, T. L. Berg, and H. D. III. Midge: Generating image descriptions from computer vision detections In EACL, 2012.
16. A. Oliva and A. Torralba. Modelling the shape of the scene: A holistic representation of the spatial envelope. IJCV, 2001.
17. V. Ordonez, G. Kulkarni, and T. L. Berg. Im2text: Describing images using 1 million captioned photographs. In NIPS, 2011.
18. K. Papineni, S. Roukos, T. Ward, and W. Zhu. Bleu: A method for automatic evaluation of machine translation. In ACL, 2002.
19. C. Rashtchian, P. Young, M. Hodosh, and J. Hockenmaier. Collecting image annotation using amazon's mechanical turk. In NAACLHLT Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, 2010.
20. M. A. Sadeghi and A. Farhadi. Recognition using visual phrases. In CVPR, 2011.
21. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In ICML, 2004.
22. Y. Verma and C. V. Jawahar. Image annotation using metric learning in semantic neighbourhoods. In ECCV, 2012.
23. K. Q. Weinberger and L. K. Saul. Distance metric learning for large margin nearest neighbor classification. 2009.
24. Y. Yang, C. L. Teo, H. D. III, and Y. Aloimonos. Corpus-guided sentence generation of natural images. In EMNLP, 2011.
25. B. Z. Yao, X. Yang, L. Lin, M. W. Lee, and S.-C. Zhu. I2t: Image parsing to text description. In Proceedings of the IEEE, 2008.