Midge: Generating image descriptions from computer vision detections

EACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings

Volumn , Issue , 2012, Pages 747-756

  Mitchell, Margaret ^a   Han, Xufeng ^e   Dodge, Jesse ^c   Mensch, Alyssa ^b   Goyal, Amit ^d   Berg, Alex ^b   Yamaguchi, Kota ^f   Berg, Tamara ^b   Stratos, Karl ^b   Daumé, Hal ^c  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^b STONY BROOK UNIVERSITY   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

^d Columbia University ^*  (United States)

^e UNIVERSITY OF WASHINGTON   (United States)

^f MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; IMAGE ANALYSIS; LINGUISTICS;

COMPUTER VISION SYSTEM; GENERATION SYSTEMS; IMAGE DESCRIPTIONS; NATURAL IMAGES; STATE-OF-THE-ART SYSTEM; SYNTACTIC TREES; VISION SYSTEMS; WORD CO-OCCURRENCE;

COMPUTER VISION;

EID: 85034832841     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Amazon. 2011. Amazon mechanical turk: Artificial artificial intelligence.
2. Holly P. Branigan, Martin J. Pickering, and Mikihiro Tanaka. 2007. Contributions of animacy to grammatical function assignment and word order during production. Lingua, 118(2):172-189.
3. Thorsten Brants and Alex Franz. 2006. Web 1T 5- gram version 1.
4. Chris Callison-Burch and Mark Dredze. 2010. Creating speech and language data with Amazon's Mechanical Turk. NAACL 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk.
5. Navneet Dalal and Bill Triggs. 2005. Histograms of oriented gradients for human detections. Proceedings of CVPR 2005.
6. Ali Farhadi, Ian Endres, Derek Hoiem, and David Forsyth. 2009. Describing objects by their attributes. Proceedings of CVPR 2009.
7. Ali Farhadi, Mohsen Hejrati, Mohammad Amin Sadeghi, Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth. 2010. Every picture tells a story: generating sentences for images. Proceedings of ECCV 2010.
8. Pedro Felzenszwalb, David McAllester, and Deva Ramaman. 2008. A discriminatively trained, multiscale, deformable part model. Proceedings of CVPR 2008.
9. Flickr. 2011. http://www.flickr.com.Accessed1.Sep.11.
10. Kotaro Funakoshi, Satoru Watanabe, Naoko Kuriyama, and Takenobu Tokunaga. 2004.Generating referring expressions using perceptual groups. Proceedings of the 3rd INLG.
11. Albert Gatt. 2006. Generating collective spatial references. Proceedings of the 28th CogSci.
12. David Graff and Christopher Cieri. 2003. English Gigaword. Linguistic Data Consortium, Philadelphia, PA. LDC Catalog No. LDC2003T05.
13. Philipp Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. MT Summit. http://www.statmt.org/europarl/.
14. Zornitsa Kozareva, Ellen Riloff, and Eduard Hovy. 2008. Semantic class learning from the web with hyponym pattern linkage graphs. Proceedings of ACL-08: HLT.
15. Girish Kulkarni, Visruth Premraj, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C. Berg, and Tamara Berg. 2011. Baby talk: Understanding and generating image descriptions. Proceedings of the 24th CVPR.
16. Irene Langkilde and Kevin Knight. 1998. Generation that exploits corpus-based statistical knowledge. Proceedings of the 36th ACL.
17. Siming Li, Girish Kulkarni, Tamara L. Berg, Alexander C. Berg, and Yejin Choi. 2011. Composing simple image descriptions using web-scale n-grams. Proceedings of CoNLL 2011.
18. Mitchell Marcus, Ann Bies, Constance Cooper, Mark Ferguson, and Alyson Littman. 1995. Treebank II bracketing guide.
19. George A. Miller. 1995. WordNet: A lexical database for english. Communications of the ACM, 38(11):39-41.
20. Margaret Mitchell, Aaron Dunlop, and Brian Roark. 2011. Semi-supervised modeling for prenominal modifier ordering. Proceedings of the 49th ACL:HLT.
21. Courtney Napoles, Benjamin Van Durme, and Chris Callison-Burch. 2011. Evaluating sentence compression: Pitfalls and suggested remedies. ACLHLT Workshop on Monolingual Text-To-Text Generation.
22. Vicente Ordonez, Girish Kulkarni, and Tamara L Berg. 2011. Im2text: Describing images using 1 million captioned photographs. Proceedings of NIPS 2011.
23. Slav Petrov. 2010. Berkeley parser. GNU General Public License v.2.
24. Cyrus Rashtchian, Peter Young, Micah Hodosh, and Julia Hockenmaier. 2010. Collecting image annotations using amazon's mechanical turk. Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk.
25. Ehud Reiter and Anja Belz. 2009. An investigation into the validity of some metrics for automatically evaluating natural language generation systems. Computational Linguistics, 35(4):529-558.
26. Ehud Reiter and Robert Dale. 1997. Building applied natural language generation systems. Journal of Natural Language Engineering, pages 57-87.
27. Ehud Reiter and Robert Dale. 2000. Building Natural Language Generation Systems. Cambridge University Press.
28. Yezhou Yang, Ching Lik Teo, Hal Dauḿe III, and Yiannis Aloimonos. 2011. Corpus-guided sentence generation of natural images. Proceedings of EMNLP 2011.
29. Benjamin Z. Yao, Xiong Yang, Liang Lin, Mun Wai Lee, and Song-Chun Zhu. 2010. I2T: Image parsing to text description. Proceedings of IEEE 2010, 98(8):1485-1508.