Towards effective tutorial feedback for explanation questions: A dataset and baselines

NAACL HLT 2012 - 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2012, Pages 200-210

  Dzikovska, Myroslava O ^a   Nielsen, Rodney D ^b   Brew, Chris ^c  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITY OF COLORADO   (United States)

^c EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH PROCESSING; TEXT PROCESSING;

BASELINE SYSTEMS; DIALOGUE SYSTEMS; EVALUATION METHODOLOGIES; LANGUAGE PROCESSING; NATURAL LANGUAGES; NON-TRIVIAL; PREDICTION TASKS; TEXTUAL ENTAILMENT;

GRADING;

EID: 84880032581     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Tarek Abudawood and Peter Flach. 2011. Learning multi-class theories in ilp. In The 20th International Conference on Inductive Logic Programming (ILP'10). Springer, June.
2. V. Aleven, O. Popescu, and K. R. Koedinger. 2001. Towards tutorial dialog to support self-explanation: Adding natural language understanding to a cognitive tutor. In Proceedings of the 10th International Conference on Artificial Intelligence in Education (AIED '01)".
3. Vincent Aleven, Octav Popescu, and Koedinger Koedinger. 2002. Pilot-testing a tutorial dialogue system that supports self-explanation. Lecture Notes in Computer Science, 2363:344-354.
4. Luisa Bentivogli, Ido Dagan, Hoa Trang Dang, Danilo Giampiccolo, and Bernando Magnini. 2009. The fifth PASCAL recognizing textual entailment challenge. In Notebook papers and results, Text Analysis Conference (TAC).
5. Charles Callaway, Myroslava Dzikovska, Colin Matheson, Johanna Moore, and Claus Zinn. 2006. Using dialogue to learn math in the LeActiveMath project. In Proceedings of the ECAI Workshop on Language- Enhanced Educational Technology, pages 1-8, August.
6. Gwendolyn C. Campbell, Natalie B. Steinhauser, Myroslava O. Dzikovska, Johanna D. Moore, Charles B. Callaway, and Elaine Farrow. 2009. The DeMAND coding scheme: A "common language" for representing and analyzing student discourse. In Proceedings of 14th International Conference on Artificial Intelligence in Education (AIED), poster session, Brighton, UK, July.
7. Michelene T. H. Chi, Nicholas de Leeuw, Mei-Hung Chiu, and Christian LaVancher. 1994. Eliciting selfexplanations improves understanding. Cognitive Science, 18(3):439-477.
8. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):3746.
9. M.C. De Marneffe, A.N. Rafferty, and C.D. Manning. 2008. Finding contradictions in text. Proceedings of ACL-08: HLT, pages 1039-1047.
10. Myroslava Dzikovska, Diana Bental, Johanna D. Moore, Natalie B. Steinhauser, Gwendolyn E. Campbell, Elaine Farrow, and Charles B. Callaway. 2010a. Intelligent tutoring with natural language support in the Beetle II system. In Sustaining TEL: From Innovation to Learning and Practice - 5th European Conference on Technology Enhanced Learning, (EC-TEL 2010), Barcelona, Spain, October.
11. Myroslava O. Dzikovska, Johanna D. Moore, Natalie Steinhauser, Gwendolyn Campbell, Elaine Farrow, and Charles B. Callaway. 2010b. Beetle II: a system for tutoring and computational linguistics experimentation. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL- 2010) demo session, Uppsala, Sweden, July.
12. Myroslava O. Dzikovska, Peter Bell, Amy Isard, and Johanna D. Moore. 2012. Evaluating language understanding accuracy with respect to objective outcomes in a dialogue system. In Proceedings of the 13th Conference of the European Chapter of the Association for computational Linguistics, Avignon, France, April.
13. Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. 2007. The third PASCAL recognizing textual entailment challenge. In Proceedings of the ACLPASCAL Workshop on Textual Entailment and Paraphrasing, pages 1-9, Prague, June.
14. Danilo Giampiccolo, Hoa Trang Dang, Bernardo Magnini, Ido Dagan, Elena Cabrio, and Bill Dolan. 2008. The fourth PASCAL recognizing textual entailment challenge. In Proceedings of Text Analysis Conference (TAC) 2008, Gaithersburg, MD, November.
15. Michael Glass. 2000. Processing language input in the CIRCSIM-Tutor intelligent tutoring system. In Proceedings of the AAAI Fall Symposium on Building Dialogue Systems for Tutorial Applications.
16. A. C. Graesser, P. Wiemer-Hastings, K. Wiemer- Hastings, and R. Kreuz. 1999. Autotutor: A simulation of a human tutor. Cognitive Systems Research, 1:35-51.
17. Pamela W. Jordan, Maxim Makatchev, and Kurt Van- Lehn. 2004. Combining competing language understanding approaches in an intelligent tutoring system. In James C. Lester, Rosa Maria Vicari, and Fábio Paraguaçu, editors, Intelligent Tutoring Systems, volume 3220 of Lecture Notes in Computer Science, pages 346-357. Springer.
18. Pamela Jordan, Maxim Makatchev, Umarani Pappuswamy, Kurt VanLehn, and Patricia Albacete. 2006. A natural language tutorial dialogue system for physics. In Proceedings of the 19th International FLAIRS conference.
19. Pamela W. Jordan. 2004. Using student explanations as models for adapting tutorial dialogue. In Valerie Barr and Zdravko Markov, editors, FLAIRS Conference. AAAI Press.
20. Lawrence Hall of Science. 2006. Assessing Science Knowledge (ask). University of California at Berkeley, NSF-0242510.
21. Lawrence Hall of Science. 2011. Full option science system.
22. Claudia Leacock and Martin Chodorow. 2003. C-rater: Automated scoring of short-answer questions. Computers and the Humanities, 37(4):389-405.
23. David D. Lewis. 1991. Evaluating text categorization. In Proceedings of the workshop on Speech and Natural Language, HLT '91, pages 312-318, Stroudsburg, PA, USA.
24. Diane Litman, Johanna Moore, Myroslava Dzikovska, and Elaine Farrow. 2009. Using natural language processing to analyze tutorial dialogue corpora across domains and modalities. In Proceedings of 14th International Conference on Artificial Intelligence in Education (AIED), Brighton, UK, July.
25. Michael Mohler, Razvan Bunescu, and Rada Mihalcea. 2011. Learning to grade short answer questions using semantic similarity measures and dependency graph alignments. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 752-762, Portland, Oregon, USA, June. Association for Computational Linguistics.
26. Rodney D. Nielsen, Wayne Ward, James H. Martin, and Martha Palmer. 2008. Annotating students' understanding of science concepts. In Proceedings of the Sixth International Language Resources and Evaluation Conference, (LREC08), Marrakech, Morocco.
27. Rodney D. Nielsen, Wayne Ward, and James H. Martin. 2009. Recognizing entailment in intelligent tutoring systems. The Journal of Natural Language Engineering, 15:479-501.
28. Heather Pon-Barry, Brady Clark, Karl Schultz, Elizabeth Owen Bratt, and Stanley Peters. 2004. Advantages of spoken language interaction in dialogue-based intelligent tutoring systems. In Proceedings of ITS- 2004, pages 390-400.
29. A. Ritter, D. Downey, S. Soderland, and O. Etzioni. 2008. It's a contradiction-no, it's not: a case study using functional relations. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 11-20.
30. Natalie B. Steinhauser, Gwendolyn E. Campbell, Leanne S. Taylor, Simon Caine, Charlie Scott, Myroslava O. Dzikovska, and Johanna D. Moore. 2011. Talk like an electrician: Student dialogue mimicking behavior in an intelligent tutoring system. In Proceedings of the 15th International Conference on Artificial Intelligence in Education (AIED-2011).
31. Kurt VanLehn, Pamela Jordan, and Diane Litman. 2007. Developing pedagogically effective tutorial dialogue tactics: Experiments and a testbed. In Proceedings of SLaTE Workshop on Speech and Language Technology in Education, Farmington, PA, October.