The event storyline corpus: A new benchmark for causal and temporal relation extraction

EventStory 2017 - Events and Stories in the News, Proceedings of the Workshop

Volumn , Issue , 2017, Pages 77-86

  Caselli, Tommaso ^a   Vossen, Piek ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; DATA MINING; NATURAL LANGUAGE PROCESSING SYSTEMS;

BASELINE SYSTEMS; BENCHMARK DATASETS; CAUSAL RELATIONS; RELATION EXTRACTION; ROBUST SYSTEMS; STORYLINES; TEMPORAL RELATION;

EXTRACTION;

EID: 85096524349     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Emmon Bach. 1986. The algebra of events. Linguistics and philosophy 9(1):5–16.
2. Mieke Bal. 1997. Narratology: Introduction to the theory of narrative. University of Toronto Press.
3. Valentina Bartalesi Lenzi, Giovanni Moretti, and Rachele Sprugnoli. 2012. CAT: the CELCT Annotation Tool. In In Proceedings of LREC 2012. pages 333–338.
4. Steven Bethard, William J Corvey, Sara Klingenstein, and James H Martin. 2008. Building a corpus of temporal-causal structure. In LREC.
5. Andrea Bonomi and Alessandro Zucchi. 2001. Tempo e linguaggio: introduzione alla semantica del tempo e dell’aspetto verbale. Pearson Italia Spa.
6. Brian Boyd. 2009. On the origin of stories. Harvard University Press.
7. Thorsten Brants and Alex Franz. 2006. Web 1t 5-gram corpus version 1.1. Google Inc .
8. Tommaso Caselli and Piek Vossen. 2016. The storyline annotation and representation scheme (star): A proposal. In Proceedings of the 2nd Workshop on Computing News Storylines (CNS 2016). Association for Computational Linguistics, Austin, Texas, pages 67–72. http://aclweb.org/anthology/W16-5708.
9. Taylor Cassidy, Bill McDowell, Nathanael Chambers, and Steven Bethard. 2014. An annotation framework for dense event ordering. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, Baltimore, Maryland, pages 501–506. http://www.aclweb.org/anthology/P14-2082.
10. Agata Cybulska and Piek Vossen. 2014a. Guidelines for ECB+ annotation of events and their coreference. Technical Report NWR-2014-1, VU University Amsterdam.
11. Agata Cybulska and Piek Vossen. 2014b. Using a sledgehammer to crack a nut? Lexical diversity and event coreference resolution. In Proceedings of the 9th Language Resources and Evaluation Conference (LREC2014). Reykjavik, Iceland.
12. Georgiana Dinu, Nghia The Pham, and Marco Baroni. 2013. Dissect - distributional semantics composition toolkit. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics: System Demonstrations. Association for Computational Linguistics, Sofia, Bulgaria, pages 31–36. http://www.aclweb.org/anthology/P13-4006.
13. Jesse Dunietz, Lori Levin, and Jaime Carbonell. 2015. Annotating causal language using corpus lexicography of constructions. In Proceedings of The 9th Linguistic Annotation Workshop. Association for Computational Linguistics, Denver, Colorado, USA, pages 188–196. http://www.aclweb.org/anthology/W15-1622.
14. Antske Fokkens, Marieke van Erp, Piek Vossen, Sara Tonelli, Willem Robert van Hage, Luciano Serafini, Rachele Sprugnoli, and Jesper Hoeksema. 2013. Gaf: A grounded annotation framework for events. In Workshop on Events: Definition, Detection, Coreference, and Representation. Association for Computational Linguistics, Atlanta, Georgia, pages 11–20. http://www.aclweb.org/anthology/W13-1202.
15. Jonathan Gottschall. 2012. The storytelling animal: How stories make us human. Houghton Mifflin Harcourt.
16. Amit Goyal, Ellen Riloff, and Hal Daume III. 2010. Automatically producing plot unit representations for narrative text. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Cambridge, MA, pages 77–86. http://www.aclweb.org/anthology/D10-1008.
17. David Jurgens, Saif Mohammad, Peter Turney, and Keith Holyoak. 2012. Semeval-2012 task 2: Measuring degrees of relational similarity. In *SEM 2012: The First Joint Conference on Lexical and Computational Semantics – Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (SemEval 2012). Association for Computational Linguistics, Montréal, Canada, pages 356–364. http://www.aclweb.org/anthology/S12-1047.
18. Wendy G Lehnert. 1981. Plot units and narrative summarization. Cognitive Science 5(4):293–331.
19. Linguistic Data Consortium. 2005. ACE (Automatic Content Extraction) English annotation guidelines for entities.
20. Inderjeet Mani. 2012. Computational modeling of narrative. Synthesis Lectures on Human Language Technologies 5(3):1–142.
21. George A Miller. 1995. Wordnet: a lexical database for english. Communications of the ACM 38(11):39–41.
22. Eleni Miltsakaki, Rashmi Prasad, Aravind K Joshi, and Bonnie L Webber. 2004. The penn discourse tree-bank. In LREC.
23. Paramita Mirza and Sara Tonelli. 2014. An analysis of causality between events and its relation to temporal information. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers. Dublin City University and Association for Computational Linguistics, Dublin, Ireland, pages 2097–2106. http://www.aclweb.org/anthology/C14-1198.
24. Paramita Mirza and Sara Tonelli. 2016. Catena: Causal and temporal relation extraction from natural language texts. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee, Osaka, Japan, pages 64–75. http://aclweb.org/anthology/C16-1007.
25. Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, and James Allen. 2016a. A corpus and evaluation framework for deeper understanding of commonsense stories. arXiv preprint arXiv:1604.01696 .
26. Nasrin Mostafazadeh, Alyson Grealish, Nathanael Chambers, James Allen, and Lucy Vanderwende. 2016b. Caters: Causal and temporal relation scheme for semantic annotation of event structures. In Proceedings of the Fourth Workshop on Events. Association for Computational Linguistics, San Diego, California, pages 51–61. http://www.aclweb.org/anthology/W16-1007.
27. Ian Niles and Adam Pease. 2001. Towards a standard upper ontology. In Proceedings of the international conference on Formal Ontology in Information Systems-Volume 2001. ACM, pages 2–9.
28. Ian Niles and Adam Pease. 2003. Mapping wordnet to the sumo ontology. In Proceedings of the ieee international knowledge engineering conference. pages 23–26.
29. Tim O’Gorman, Kristin Wright-Bettner, and Martha Palmer. 2016. Richer event description: Integrating event coreference with temporal, causal and bridging annotation. In Proceedings of the 2nd Workshop on Computing News Storylines (CNS 2016). Association for Computational Linguistics, Austin, Texas, pages 47–56. http://aclweb.org/anthology/W16-5706.
30. James Pustejovsky, José Castao, Robert Ingria, Roser Saurì, Robert Gaizauskas, Andrea Setzer, and Graham Katz. 2003a. TimeML: Robust Specification of Event and Temporal Expressions in Text. In Fifth International Workshop on Computational Semantics (IWCS-5).
31. James Pustejovsky and Amber Stubbs. 2011. Increasing informativeness in temporal annotation. In Proceedings of the 5th Linguistic Annotation Workshop. Association for Computational Linguistics, Portland, Oregon, USA, pages 152–160. http://www.aclweb.org/anthology/W11-0419.
32. Marco Rospocher, Marieke van Erp, Piek Vossen, Antske Fokkens, Itziar Aldabe, German Rigau, Aitor Soroa, Thomas Ploeger, and Tessel Bogaard. 2016. Building event-centric knowledge graphs from news. Web Semantics: Science, Services and Agents on the World Wide Web 37:132–151.