Sort Story: Sorting jumbled images and captions into stories

EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings

Volumn , Issue , 2016, Pages 925-931

  Agrawal, Harsh ^a   Chandrasekaran, Arjun ^a   Batra, Dhruv ^a,c   Parikh, Devi ^a,c   Bansal, Mohit ^b,d  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^d UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

ALIGNED IMAGES; COMMON SENSE; IMAGE-BASED FEATURES; MULTI-DOCUMENT SUMMARIZATION; OUTPUT SEQUENCES;

IMAGE ENHANCEMENT;

EID: 85072836458     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d16-1091     Document Type: Conference Paper

References (41)

1. Tali Basha, Yael Moses, and Shai Avidan. 2012. Photo sequencing. In ECCV. 2
2. Branimir Boguraev and Rie Kubota Ando. 2005. Timeml-compliant text analysis for temporal reasoning. In IJCAI. 2
3. Antoine Bosselut, Jianfu Chen, David Warren, Hannaneh Hajishirzi, and Yejin Choi. 2016. Learning prototypical event structure from photo albums. In ACL. 2
4. Nathanael Chambers and Daniel Jurafsky. 2008. Unsupervised learning of narrative event chains. In ACL. Citeseer. 2
5. Danqi Chen and Christopher D Manning. 2014. A fast and accurate dependency parser using neural networks. In EMNLP. 5
6. Harr Chen, SRK Branavan, Regina Barzilay, David R Karger, et al. 2009. Content modeling using latent permutations. Journal of Artificial Intelligence Research.
7. Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In EMNLP.
8. Jinsoo Choi, Tae-Hyun Oh, and In So Kweon. 2016. Video-story composition via plot analysis. In CVPR.
9. Anthony Fader, Luke Zettlemoyer, and Oren Etzioni. 2014. Open question answering over curated and extracted knowledge bases. In ACM SIGKDD. 1
10. LI Hang. 2011. A short introduction to learning to rank. IEICE TRANSACTIONS on Information and Systems. 3
11. Janet Hitzeman, Marc Moens, and Claire Grover. 1995. Algorithms for analysing the temporal structure of discourse. In EACL. 2
12. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation. 3
13. Andrew Kehler. 2000. Coherence and the resolution of ellipsis. Linguistics and Philosophy. 2
14. Gunhee Kim and Eric Xing. 2014. Reconstructing storyline graphs for image recommendation from web community photos. In CVPR. 2
15. Gunhee Kim, Leonid Sigal, and Eric Xing. 2014. Joint summarization of large-scale collections of web images and videos for storyline reconstruction. In CVPR. 2
16. Gunhee Kim, Seungwhan Moon, and Leonid Sigal. 2015. Joint photo stream and blog post summarization and exploration. In CVPR. 2
17. Ryan Kiros, Yukun Zhu, Ruslan R Salakhutdinov, Richard Zemel, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Skip-thought vectors. In NIPS. 3
18. Mirella Lapata and Alex Lascarides. 2006. Learning sentence-internal temporal relations. Journal of Artificial Intelligence Research. 2
19. Inderjeet Mani and Barry Schiffman. 2005. Temporally anchoring and ordering events in news. Time and Event Recognition in Natural Language. John Benjamins. 2
20. Inderjeet Mani, Marc Verhagen, Ben Wellner, Chong Min Lee, and James Pustejovsky. 2006. Machine learning of temporal relations. In COLING-ACL. 2
21. Ashutosh Modi and Ivan Titov. 2014. Inducing neural models of script knowledge. In CoNLL. 2
22. Ashutosh Modi. 2016. Event embeddings for semantic script modeling. In CoNLL. 2
23. Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, and James Allen. 2016. A corpus and cloze evaluation for deeper understanding of commonsense stories. In NAACL.
24. James Munkres. 1957. Algorithms for the assignment and transportation problems. Journal of the Society for Industrial and Applied Mathematics. 3
25. Rebecca J Passonneau. 1988. A computational model of the semantics of tense and aspect. Computational Linguistics. 2
26. Lyndsey Pickup, Zheng Pan, Donglai Wei, YiChang Shih, Changshui Zhang, Andrew Zisserman, Bernhard Scholkopf, and William Freeman. 2014. Seeing the arrow of time. In CVPR. 2
27. James Pustejovsky, Patrick Hanks, Roser Sauri, Andrew See, Robert Gaizauskas, Andrea Setzer, Dragomir Radev, Beth Sundheim, David Day, Lisa Ferro, et al. 2003. The timebank corpus. In Corpus linguistics. 2
28. Vignesh Ramanathan, Kevin Tang, Greg Mori, and Li Fei-Fei. 2015. Learning temporal embeddings for complex video analysis. In CVPR.
29. Mengye Ren, Ryan Kiros, and Richard Zemel. 2015. Exploring models and data for image question answering. In NIPS. 1
30. Matthew Richardson, Christopher JC Burges, and Erin Renshaw. 2013. Mctest: A challenge dataset for the open-domain machine comprehension of text. In EMNLP. 1
31. Roger C Schank and Robert P Abelson. 2013. Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Psychology Press. 2
32. Gunnar A Sigurdsson, Xinlei Chen, and Abhinav Gupta. 2016. Learning visual storylines with skipping recurrent neural networks. In ECCV. 2
33. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. 3
34. Charles Spearman. 1904. The proof and measurement of association between two things. The American journal of psychology. 4
35. Nasrin Mostafazadeh Ishan Misra Aishwarya Agrawal Jacob Devlin Ross Girshick Xiaodong He Pushmeet Kohli Dhruv Batra C. Lawrence Zitnick Devi Parikh Lucy Vanderwende Michel Galley Margaret Mitchell Ting-Hao Huang, Francis Ferraro. 2016. Visual storytelling. In NAACL. 1, 4
36. David Trottier. 1998. The screenwriter's bible: A complete guide to writing, formatting, and selling your script. Silman-James Press. 5
37. Ivan Vendrov, Ryan Kiros, Sanja Fidler, and Raquel Urtasun. 2016. Order-embeddings of images and language. In ICLR.
38. William Yang Wang, Yashar Mehdad, Dragomir R Radev, and Amanda Stent. 2016. A low-rank approximation approach to learning joint embeddings of news stories and images for timeline summarization. In NAACL. 2
39. Bonnie Lynn Webber. 1988. Tense as discourse anaphor. Computational Linguistics. 2
40. Jason Weston, Antoine Bordes, Sumit Chopra, and Tomas Mikolov. 2015. Towards AI-complete question answering: A set of prerequisite toy tasks. arXiv preprint arXiv:1502.05698. 1
41. Yukun Zhu, Ryan Kiros, Rich Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. In CVPR. 3