Overview of QA4MRE at CLEF 2011: Question answering for machine reading evaluation

CEUR Workshop Proceedings

Volumn 1177, Issue , 2011, Pages

  Peñas, Anselmo ^a   Hovy, Eduard ^b   Forner, Pamela ^c   Rodrigo, Álvaro ^a   Sutcliffe, Richard ^d   Forascu, Corina ^e   Sporleder, Caroline ^f  

^a UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c CELCT ^*  (Italy)

^d UNIVERSITY OF LIMERICK   (Ireland)

^e ALEXANDRU IOAN CUZA UNIVERSITY OF IASI   (Romania)

^f SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP KNOWLEDGE; MAIN TASKS; PILOT TASKS; QUESTION ANSWERING; READING COMPREHENSION TESTS; ROMANIANS; SHORT TEXTS;

EID: 84922032477     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Anselmo Peñas. Álvaro Rodrigo. Felisa Verdejo. Overview of the Answer Validation Exercise 2007. In C. Peters. V. Jijkoun. Th. Mandl. H. Müller. D.W. Oard. A. Peñas. V. Petras. and D. Santos. (Eds.): Advances in Multilingual and Multimodal Information Retrieval. LNCS 5152. September 2008.
2. Anselmo Peñas. Álvaro Rodrigo. Valentín Sama. Felisa Verdejo. Overview of the Answer Validation Exercise 2006. In C. Peters. P. Clough. F. C. Gey. J. Karlgren. B. Magnini. D. W. Oard. M. de Rijke. M. Stempfhuber (Eds.): Evaluation of Multilingual and Multi-modal Information Retrieval. 7th Workshop of the Cross-Language Evaluation Forum. CLEF 2006. Alicante. Spain. September 20-22. 2006. Revised Selected Papers.
3. Álvaro Rodrigo. Anselmo Peñas. Felisa Verdejo. Overview of the Answer Validation Exercise 2008. In C. Peters. Th. Mandl. V. Petras. A. Peñas. H. Müller. D. Oard. V. Jijkoun. D. Santos (Eds). Evaluating Systems for Multilingual and Multimodal Information Access, 9th Workshop of the Cross-Language Evaluation Forum. CLEF 2008. Aarhus. Denmark. September 17-19. 2008. Revised Selected Papers.
4. Ido Dagan. Oren Glickman. and Bernardo Magnini. The PASCAL Recognising Textual Entailment Challenge. In Lecture Notes in Computer Science. volume 3944. pages 177-190. Springer. 2005.
5. Oren Etzioni. Michele Banko. and Michael J. Cafarella. Machine reading. In Proceedings of the 21st National Conference on Artificial Intelligence. 2006.
6. Ellen M. Voorhees and Dawn M. Tice. The TREC-8 Question Answering Track Evaluation. In Text Retrieval Conference TREC-8. pages 83-105. 1999.
7. B. Wellner. L. Ferro. W. Greiff and L. Hirschman. Reading Comprehension Tests for Computer-based Understanding Evaluation. Nat. Lang. Eng. 12. 4. 305-334. 2006.
8. Anselmo Peñas. Pamela Forner. Richard Sutcliffe. Álvaro Rodrigo. Corina Forascu. Iñaki Alegria. Danilo Giampiccolo. Nicolas Moreau. Petya Osenova. Overview of ResPubliQA 2009: Question Answering Evaluation over European Legislation. In C. Peters. G. di Nunzio. M. Kurimo. Th. Mandl. D. Mostefa. A. Peñas. G. Roda (Eds.). Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments, Workshop of the Cross- Language Evaluation Forum CLEF 2009. Corfu. Greece. 30 September - 2 October. Revised Selected Papers. Lecture Notes in Computer Science 6241. Springer-Verlag. 2010.
9. Anselmo Peñas and Alvaro Rodrigo. A Simple Measure to Assess Non-response. In Proceedings of 49th Annual Meeting of the Association for Computational Linguistics - Human Language Technologies (ACL-HLT 2011). Portland. Oregon. USA. June 19-24. 2011.
10. David Ferrucci. Eric Brown. Jennifer Chu-Carroll. James Fan. David Gondek. Aditya A. Kalyanpur. Adam Lally. J. William Murdock. Eric Nyberg. John Prager. Nico Schlaefer. and Chris Welty. 2010. Building Watson: An Overview of the DeepQA Project. AI Magazine. 31(3).
11. Roser Morante and Walter Daelemans. Annotating Modality and Negation for a Machine Reading Evaluation. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
12. Juan Martinez-Romo and Lourdes Araujo. Graph-based Word Clustering Applied to Question Answering and Reading Comprehension Tests. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
13. Adrian Iftene, Alexandru-Lucian GÎnsca, Alex Moruz, Diana Trandabat, Maria Husarciuc. Question Answering for Machine Reading Evaluation on Romanian and English. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
14. Gaurav Arora. Cosine similarity as Machine Reading Technique. Question Answering for Machine Reading Evaluation on Romanian and English. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
15. Suzan Verberne. Retrieval-based Question Answering for Machine Reading Evaluation. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
16. Partha Pakray, Pinaki Bhaskar, Somnath Banerjee, Bidhan Chandra Pal, Alexander Gelbukh and Sivaji Bandyopadhyay. JU-CSE-TE: System Description QA4MRE@CLEF 2011. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
17. Svitlana Babych, Alexander Henn, Jan Pawellek, and Sebastian Padò. Dependency-Based Answer Validation for German. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
18. Ling Cao, Xipeng Qiu and Xuanjing Huang. Question Answering for Machine Reading with Lexical Chain. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.
19. Ingo Glockner, Bjorn Pelzer, and Tiansi Dong. The Log Answer Project at QA4MRE 2011. CLEF 2011 Labs and Workshop - Notebook Papers. 19-22 September, Amsterdam, The Netherlands. Online Proceedings.