Collective generation of natural image descriptions

50th Annual Meeting of the Association for Computational Linguistics, ACL 2012 - Proceedings of the Conference

Volumn 1, Issue , 2012, Pages 359-368

  Kuznetsova, Polina ^a   Ordonez, Vicente ^a   Berg, Alexander C ^a   Berg, Tamara L ^a   Choi, Yejin ^a  

^a Stony Brook University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRAINT OPTIMIZATION PROBLEMS; DATA-DRIVEN APPROACH; DISCOURSE STRUCTURE; GENERATION PROCESS; IMAGE DESCRIPTIONS; LANGUAGE COMPOSITIONS; NATURAL LANGUAGES; PARALLEL IMAGES;

DIGITAL STORAGE;

COMPUTATIONAL LINGUISTICS;

EID: 84878189119     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Ahmet Aker and Robert Gaizauskas. 2010. Generating image descriptions using dependency relational patterns. In ACL.
2. Anja Belz and Ehud Reiter. 2006. Comparing automatic and human evaluation of nlg systems. In EACL 2006, 11st Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, April 3-7, 2006, Trento, Italy. The Association for Computer Linguistics.
3. Thorsten Brants and Alex Franz. 2006. Web 1t 5- gram version 1. In Linguistic Data Consortium.
4. James Clarke and Mirella Lapata. 2006. Constraintbased sentence compression: An integer programming approach. In Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions, pages 144-151, Sydney, Australia, July. Association for Computational Linguistics.
5. Navneet Dalal and Bill Triggs. 2005. Histograms of oriented gradients for human detection. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01, CVPR '05, pages 886-893, Washington, DC, USA. IEEE Computer Society.
6. Haris Dindo and Daniele Zambuto. 2010. A probabilistic approach to learning a visually grounded language model through human-robot interaction. In IROS, pages 790-796. IEEE.
7. Ali Farhadi, Mohsen Hejrati, Mohammad Amin Sadeghi, Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth. 2010. Every picture tells a story: generating sentences for images. In ECCV.
8. Pedro F. Felzenszwalb, Ross B. Girshick, David McAllester, and Deva Ramanan. 2010. Object detection with discriminatively trained part based models. tPAMI, Sept.
9. Yansong Feng and Mirella Lapata. 2010. How many words is a picture worth? automatic caption generation for news images. In ACL.
10. Fateh Muhammad Hafiz and Ian Tudor. 1989. Extensive reading and the development of language skills. ELT Journal, 43(1):4-13.
11. Girish Kulkarni, Visruth Premraj, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C Berg, and Tamara L Berg. 2011. Babytalk: Understanding and generating simple image descriptions. In CVPR.
12. Thomas K. Leung and Jitendra Malik. 1999. Recognizing surfaces using three-dimensional textons. In ICCV.
13. Siming Li, Girish Kulkarni, Tamara L. Berg, Alexander C. Berg, and Yejin Choi. 2011. Composing simple image descriptions using web-scale ngrams. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning, pages 220-228, Portland, Oregon, USA, June. Association for Computational Linguistics.
14. David G. Lowe. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60:91-110, November.
15. Andre Martins and Noah A. Smith. 2009. Summarization with a joint model for sentence extraction and compression. In Proceedings of the Workshop on Integer Linear Programming for Natural Language Processing, pages 1-9, Boulder, Colorado, June. Association for Computational Linguistics.
16. Derek D. Monner and James A. Reggia. 2011. Systematically grounding language through vision in a deep, recurrent neural network. In Proceedings of the 4th international conference on Artificial general intelligence, AGI'11, pages 112-121, Berlin, Heidelberg. Springer-Verlag.
17. Vicente Ordonez, Girish Kulkarni, and Tamara L. Berg. 2011. Im2text: Describing images using 1 million captioned photographs. In Neural Information Processing Systems (NIPS).
18. Kishore Papineni, Salim Roukos, Todd Ward, and Wei jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In ACL.
19. Slav Petrov and Dan Klein. 2007. Improved inference for unlexicalized parsing. In HLT-NAACL.
20. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In COLING/ACL.
21. Deb K. Roy. 2002. Learning visually-grounded words and syntax for a scene description task. Computer Speech and Language, In review.
22. Wai-King Tsang. 1996. Comparing the effects of reading and writing on writing performance. Applied Linguistics, 17(2):210-233.
23. Kristian Woodsend and Mirella Lapata. 2010. Automatic generation of story highlights. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 565- 574, Uppsala, Sweden, July. Association for Computational Linguistics.
24. Kristian Woodsend, Yansong Feng, and Mirella Lapata. 2010. Title generation with quasisynchronous grammar. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP '10, pages 513-523, Stroudsburg, PA, USA. Association for Computational Linguistics.
25. Jianxiong Xiao, James Hays, Krista A. Ehinger, Aude Oliva, and Antonio Torralba. 2010. Sun database: Large-scale scene recognition from abbey to zoo. In CVPR.
26. Yezhou Yang, Ching Teo, Hal Daume III, and Yiannis Aloimonos. 2011. Corpus-guided sentence generation of natural images. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 444-454, Edinburgh, Scotland, UK., July. Association for Computational Linguistics.
27. Benjamin Z. Yao, Xiong Yang, Liang Lin, Mun Wai Lee, and Song-Chun Zhu. 2010. I2t: Image parsing to text description. Proc. IEEE, 98(8).