SemEval-2013 Task 7: The joint student response analysis and 8th recognizing textual entailment challenge

*SEM 2013 - 2nd Joint Conference on Lexical and Computational Semantics

Volumn 2, Issue , 2013, Pages 263-274

  Dzikovska, Myroslava O ^a   Nielsen, Rodney D ^b   Brew, Chris ^c   Giampiccolo, Danilo ^d   Clark, Peter ^e   Leacock, Claudia ^f   Bentivogli, Luisa ^g   Dagan, Ido ^h   Dang, Hoa Trang ⁱ  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITY OF NORTH TEXAS   (United States)

^c NUANCE COMMUNICATIONS   (United States)

^d CELCT   (Italy)

^e VULCAN INC   (United States)

^f CTB MCGRAW HILL   (United States)

^g FONDAZIONE BRUNO KESSLER   (Italy)

^h BAR ILAN UNIVERSITY   (Israel)

ⁱ NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

STUDENTS; TEXT PROCESSING;

PARTIAL ENTAILMENT; PARTICIPATING TEAMS; RECOGNIZING TEXTUAL ENTAILMENTS; SEMANTIC INFERENCE; STUDENT RESPONSE; TEXTUAL ENTAILMENT;

SEMANTICS;

EID: 84994088253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Yigal Attali and Jill Burstein. 2006. Automated essay scoring with e-rater v.2. The Journal of Technology, Learning, and Assessment, 4(3), February.
2. Daniel Bär, Chris Biemann, Iryna Gurevych, and Torsten Zesch. 2012. Ukp: Computing semantic textual similarity by combining multiple content similarity measures. In Proceedings of the 6th International Workshop on Semantic Evaluation, held in conjunction with the 1st Joint Conference on Lexical and Computational Semantics, pages 435–440, Montreal, Canada, June.
3. Luisa Bentivogli, Ido Dagan, Hoa Trang Dang, Danilo Giampiccolo, and Bernando Magnini. 2009. The fifth PASCAL recognizing textual entailment challenge. In Proceedings of Text Analysis Conference (TAC) 2009.
4. Luisa Bentivogli, Peter Clark, Ido Dagan, Hoa Trang Dang, and Danilo Giampiccolo. 2010. Thesixth PASCAL recognizing textual entailment challenge. In Notebook papers and results, Text Analysis Conference (TAC).
5. Luisa Bentivogli, Peter Clark, Ido Dagan, Hoa Trang Dang, and Danilo Giampiccolo. 2011. The seventh PASCAL recognizing textual entailment challenge. In Notebook papers and results, Text Analysis Conference (TAC).
6. Ido Dagan, Oren Glickman, and Bernardo Magnini. 2006. The pascal recognising textual entailment challenge. In J. Quinonero-Candela, ¯ I. Dagan, B. Magnini, and F. d’Alché Buc, editors, Machine Learning Challenges, volume 3944 of Lecture Notes in Computer Science. Springer.
7. Myroslava O. Dzikovska, Johanna D. Moore, Natalie Steinhauser, Gwendolyn Campbell, Elaine Farrow, and Charles B. Callaway. 2010. Beetle II: a system for tutoring and computational linguistics experimentation. In Proc. of ACL 2010 System Demonstrations, pages 13–18.
8. Myroslava O. Dzikovska, Rodney D. Nielsen, and Chris Brew. 2012. Towards effective tutorial feedback for explanation questions: A dataset and baselines. In Proc. of 2012 Conference of NAACL: Human Language Technologies, pages 200–210.
9. Danilo Giampiccolo, Hoa Trang Dang, Bernardo Magnini, Ido Dagan, Elena Cabrio, and Bill Dolan. 2008. The fourth PASCAL recognizing textual entailment challenge. In Proceedings of Text Analysis Conference (TAC) 2008, Gaithersburg, MD, November.
10. Michael Glass. 2000. Processing language input in the CIRCSIM-Tutor intelligent tutoring system. In Papers from the 2000 AAAI Fall Symposium, Available as AAAI technical report FS-00-01, pages 74–79.
11. A. C. Graesser, K. Wiemer-Hastings, P. Wiemer-Hastings, and R. Kreuz. 1999. Autotutor: A simulation of a human tutor. Cognitive Systems Research, 1:35–51.
12. Xiangen Hu, Zhiqiang Cai, Max Louwerse, Andrew Ol-ney, Phanni Penumatsa, and Art Graesser. 2003. A revised algorithm for latent semantic analysis. In Proceedings of the 18th International Joint Conference on Artificial intelligence (IJCAI’03), pages 1489–1491, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
13. Pamela W. Jordan, Maxim Makatchev, and Kurt VanLehn. 2004. Combining competing language understanding approaches in an intelligent tutoring system. In Proc. of Intelligent Tutoring Systems Conference, pages 346–357.
14. Pamela Jordan, Maxim Makatchev, Umarani Pap-puswamy, Kurt VanLehn, and Patricia Albacete. 2006. A natural language tutorial dialogue system for physics. In Proc. of 19th Intl. FLAIRS conference, pages 521–527.
15. Claudia Leacock and Martin Chodorow. 2003. C-rater: Automated scoring of short-answer questions. Computers and the Humanities, 37(4):389–405.
16. Claudia Leacock, Martin Chodorow, Michael Gamon, and Joel R. Tetreault. 2010. Automated Grammatical Error Detection for Language Learners. Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers.
17. Philip M. McCarthy, Vasile Rus, Scott A. Crossley, Arthur C. Graesser, and Danielle S. McNamara. 2008. Assessing forward-, reverse-, and average-entailment indices on natural language input from the intelligent tutoring system, iSTART. In Proc. of 21st Intl. FLAIRS conference, pages 165–170.
18. Michael Mohler, Razvan Bunescu, and Rada Mihalcea. 2011. Learning to grade short answer questions using semantic similarity measures and dependency graph alignments. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 752–762, Portland, Oregon, USA, June. Association for Computational Linguistics.
19. Jessica Nelson, Charles Perfetti, David Liben, and Meredith Liben. 2012. Measures of text difficulty: Testing their predictive value for grade levels and student performance. Technical report, Student Achievement Partners. http://www.ccsso.org/Documents/2012/Measures%20ofText% 20Difficulty_fina%l.2012.pdf.
20. Rodney D. Nielsen, Wayne Ward, and James H. Martin. 2008a. Learning to assess low-level conceptual understanding. In Proc. of 21st Intl. FLAIRS Conference, pages 427–432.
21. Rodney D. Nielsen, Wayne Ward, James H. Martin, and Martha Palmer. 2008b. Annotating students’ understanding of science concepts. In Proceedings of the Sixth International Language Resources and Evaluation Conference, (LREC08), Marrakech, Morocco.
22. Sarah Petersen and Mari Ostendorf. 2009. A machine learning approach to reading level assessment. Computer, Speech and Language, 23(1):89–106.
23. Heather Pon-Barry, Brady Clark, Karl Schultz, Elizabeth Owen Bratt, and Stanley Peters. 2004. Advantages of spoken language interaction in dialogue-based intelligent tutoring systems. In Proc. of ITS-2004 Conference, pages 390–400.
24. Stephen G Pulman and Jana Z Sukkarieh. 2005. Automatic short answer marking. In Proceedings of the Second Workshop on Building Educational Applications Using NLP, pages 9–16, Ann Arbor, Michigan, June. Association for Computational Linguistics.
25. Kathryn M. Sheehan, Irene Kostin, Yoko Futagi, and Michael Flor. 2010. Generating automated text complexity classifications that are aligned with targeted text complexity standards. Technical Report RR-10-28, Educational Testing Service.
26. Mark D. Shermis and Jill Burstein, editors. 2013. Handbook on Automated Essay Evaluation: Current Applications and New Directions. Routledge.
27. Asher Stern and Ido Dagan. 2011. A confidence model for syntactically-motivated entailment proofs. In Recent Advances in Natural Language Processing (RANLP 2011), pages 455–462, Hissar, Bulgaria, September.
28. Grigorios Tsoumakas, Ioannis Katakis, and Ioannis Vla-havas. 2010. Mining multi-label data. In Oded Maimon and Lior Rokach, editors, Data Mining and Knowledge Discovery Handbook, pages 667–685. Springer US.
29. Kurt VanLehn, Pamela Jordan, and Diane Litman. 2007. Developing pedagogically effective tutorial dialogue tactics: Experiments and a testbed. In Proc. of SLaTE Workshop on Speech and Language Technology in Education, Farmington, PA, October.
30. Alexander Yeh. 2000. More accurate tests for the statistical significance of result differences. In Proceedings of the 18th International Conference on Computational linguistics (COLING 2000), pages 947–953, Stroudsburg, PA, USA. Association for Computational Linguistics.