A corpus and cloze evaluation for deeper understanding of commonsense stories

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

Volumn , Issue , 2016, Pages 839-849

  Mostafazadeh, Nasrin ^a   Chambers, Nathanael ^b   He, Xiaodong ^c   Parikh, Devi ^d   Batra, Dhruv ^d   Vanderwende, Lucy ^c   Kohli, Pushmeet ^c   Allen, James ^a,e  

^a UNIVERSITY OF ROCHESTER   (United States)

^b UNITED STATES NAVAL ACADEMY   (United States)

^c MICROSOFT RESEARCH   (United States)

^d VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^e INSTITUTE FOR HUMAN AND MACHINE COGNITION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMONSENSE KNOWLEDGE; EVALUATION FRAMEWORK; EXPERIMENTAL EVALUATION; FOUNDATIONAL PROBLEMS; LANGUAGE UNDERSTANDING; STATE OF THE ART; STORY GENERATIONS; STORY UNDERSTANDING;

COMPUTATIONAL LINGUISTICS;

EID: 84994079330     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/n16-1098     Document Type: Conference Paper

References (46)

1. James F. Allen, Mary Swift, and Will de Beaumont. 2008. Deep semantic analysis of text. In Proceedings of the 2008 Conference on Semantics in Text Processing, STEP '08, pages 343-354, Stroudsburg, PA, USA. Association for Computational Linguistics.
2. Paul Bailey. 1999. Searching for storiness: Story-generation from a reader's perspective. In AAAI Fall Symposium on Narrative Intelligence.
3. Niranjan Balasubramanian, Stephen Soderland, Oren Etzioni Mausam, and Oren Etzioni. 2013. Generating coherent event schemas at scale. In EMNLP, pages 1721-1731.
4. David Bamman, Brendan OConnor, and Noah Smith. 2013. Learning latent personas of film characters. ACL.
5. Samuel R Bowman, Gabor Angeli, Christopher Potts, and Christopher D Manning. 2015. Learning natural language inference from a large annotated corpus. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 632-642, Stroudsburg, PA. Association for Computational Linguistics.
6. K. Burton, A. Java, , and I. Soboroff. 2009. The icwsm 2009 spinn3r dataset. In In Proceedings of the Third Annual Conference on Weblogs and Social Media (ICWSM 2009), San Jose, CA.
7. Nathanael Chambers and Daniel Jurafsky. 2008. Unsupervised learning of narrative event chains. In Kathleen McKeown, Johanna D. Moore, Simone Teufel, James Allan, and Sadaoki Furui, editors, ACL, pages 789-797. The Association for Computer Linguistics.
8. Nathanael Chambers and Dan Jurafsky. 2009. Unsupervised learning of narrative schemas and their participants. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2, ACL '09, pages 602-610, Stroudsburg, PA, USA. Association for Computational Linguistics.
9. Nathanael Chambers. 2013. Event schema induction with a probabilistic entity-driven model. In EMNLP, volume 13, pages 1797-1807.
10. Eugene Charniak. 1972. Toward a model of children's story comprehension. December.
11. Jackie Cheung, Hoifung Poon, and Lucy Vanderwende. 2013. Probabilistic frame induction. In ACL.
12. E.M. Forster. 1927. Aspects of the Novel. Edward Arnold, London.
13. Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third pascal recognizing textual entailment challenge. In Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, RTE '07, pages 1-9, Stroudsburg, PA, USA. ACL.
14. Andrew S. Gordon and Reid Swanson. 2009. Identifying Personal Stories in Millions of Weblog Entries. In Third International Conference on Weblogs and Social Media, Data Challenge Workshop, San Jose, CA, May.
15. Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015. Teaching machines to read and comprehend. In C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems 28, pages 1693-1701. Curran Associates, Inc.
16. Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. 2013. Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22Nd ACM International Conference on Information & Knowledge Management, CIKM '13, pages 2333-2338, New York, NY, USA. ACM.
17. Bram Jans, Steven Bethard, Ivan Vulić, and Marie Francine Moens. 2012. Skip n-grams and ranking functions for predicting script events. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 336-344. Association for Computational Linguistics.
18. Ryan Kiros, Yukun Zhu, Ruslan Salakhutdinov, Richard S Zemel, Antonio Torralba, Raquel Urtasun, and Sanja Fidler. 2015. Skip-thought vectors. NIPS.
19. Hector J. Levesque. 2011. The winograd schema challenge. In AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning. AAAI.
20. Chin-Yew Lin and Franz Josef Och. 2004. Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics. In Proceedings of the 42Nd Annual Meeting on Association for Computational Linguistics, ACL '04, Stroudsburg, PA, USA. Association for Computational Linguistics.
21. Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 55-60.
22. Mehdi Manshadi, Reid Swanson, and Andrew S. Gordon. 2008. Learning a Probabilistic Model of Event Sequences From Internet Weblog Stories. In 21st Conference of the Florida AI Society, Applied Natural Language Processing Track, Coconut Grove, FL, May.
23. Neil McIntyre and Mirella Lapata. 2009. Learning to tell tales: A data-driven approach to story generation. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 217-225, Singapore.
24. Gonzalo Méndez, Pablo Gervás, and Carlos León. 2014. A model of character affinity for agent-based story generation. In 9th International Conference on Knowledge, Information and Creativity Support Systems, Limassol, Cyprus, 11/2014. Springer-Verlag, Springer-Verlag.
25. Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5-8, 2013, Lake Tahoe, Nevada, United States., pages 3111-3119.
26. G. Miller. 1995. Wordnet: A lexical database for english. In In Communications of the ACM.
27. Nasrin Mostafazadeh, Alyson Grealish, Nathanael Chambers, James F. Allen, and Lucy Vanderwende. 2016. Caters: Causal and temporal relation scheme for semantic annotation of event structures. In Proceedings of the The 4th Workshop on EVENTS: Definition, Detection, Coreference, and Representation, San Diego, California, June. Association for Computational Linguistics.
28. Erik T. Mueller. 2002. Understanding script-based stories using commonsense reasoning. Cognitive Systems Research, 5:2004.
29. Erik T. Mueller. 2007. Modeling space and time in narratives about restaurants. LLC, 22(1):67-84.
30. Kiem-Hieu Nguyen, Xavier Tannier, Olivier Ferret, and Romaric Besançon. 2015. Generative event schema induction with entity disambiguation. In Proceedings of the 53rd annual meeting of the Association for Computational Linguistics (ACL-15).
31. Karl Pichotta and Raymond J Mooney. 2014a. Statistical script learning with multi-argument events. EACL 2014, page 220.
32. Karl Pichotta and Raymond J. Mooney. 2014b. Statistical script learning with multi-argument events. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2014), Gothenburg, Sweden, April.
33. James Pustejovsky, Jos Castao, Robert Ingria, Roser Saur, Robert Gaizauskas, Andrea Setzer, and Graham Katz. 2003. Timeml: Robust specification of event and temporal expressions in text. In in Fifth International Workshop on Computational Semantics (IWCS-5.
34. Michaela Regneri, Alexander Koller, and Manfred Pinkal. 2010. Learning script knowledge with web experiments. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 979-988. Association for Computational Linguistics.
35. Matthew Richardson, Christopher J. C. Burges, and Erin Renshaw. 2013. Mctest: A challenge dataset for the open-domain machine comprehension of text. In EMNLP, pages 193-203. ACL.
36. M. Riedl and Carlos León. 2008. Toward vignette-based story generation for drama management systems. In Workshop on Integrating Technologies for Interactive Stories - 2nd International Conference on INtelligent TEchnologies for interactive enterTAINment, 8-10/1.
37. Melissa Roemmele, Cosmin Adrian Bejan, and Andrew S. Gordon. 2011. Choice of Plausible Alternatives: An Evaluation of Commonsense Causal Reasoning. In AAAI Spring Symposium on Logical Formalizations of Commonsense Reasoning, Stanford University, March.
38. Rachel Rudinger, Pushpendre Rastogi, Francis Ferraro, and Benjamin Van Durme. 2015. Script induction as language modeling. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP-15).
39. Roger C. Schank and Robert P. Abelson. 1977. Scripts, Plans, Goals and Understanding: an Inquiry into Human Knowledge Structures. L. Erlbaum, Hillsdale, NJ.
40. Lenhart K. Schubert and Chung Hee Hwang. 2000. Episodic logic meets little red riding hood: A comprehensive, natural representation for language understanding. In Natural Language Processing and Knowledge Representation: Language for Knowledge and Knowledge for Language. MIT/AAAI Press.
41. Reid Swanson and Andrew S. Gordon. 2008. Say Anything: A Massively collaborative Open Domain Story Writing Companion. In First International Conference on Interactive Digital Storytelling, Erfurt, Germany, November.
42. Wilson L Taylor. 1953. Cloze procedure: a new tool for measuring readability. Journalism quarterly.
43. Scott R. Turner. 1994. The creative process: A computer model of storytelling. Hillsdale: Lawrence Erlbaum.
44. Jason Weston, Antoine Bordes, Sumit Chopra, and Tomas Mikolov. 2015. Towards ai-complete question answering: A set of prerequisite toy tasks. CoRR, abs/1502.05698.
45. Terry Winograd. 1972. Understanding Natural Language. Academic Press, Inc., Orlando, FL, USA.
46. Yukun Zhu, Ryan Kiros, Richard Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. In arXiv preprint arXiv:1506.06724.