Building a textual entailment suite for the evaluation of automatic content scoring technologies

Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010

Volumn , Issue , 2010, Pages 3149-3156

  Sukkarieh, Jana Z ^a   Bolge, Eleanor ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; TEXT PROCESSING;

AUTOMATIC CONTENT; COMPARATIVE EVALUATIONS; EDUCATIONAL TESTING; EVALUATION MEASURES; MACHINE TRANSLATIONS; NATURALLY OCCURRING; QUESTION ANSWERING; TEXTUAL ENTAILMENT;

BENCHMARKING;

EID: 84952704633     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Callear, D., Jerrams-Smith, J. & Soh, V. (2001) CAA of short nonMCQ answers. In the Proceedings of the 5th International Computer Assisted Assessment Conference, Loughborough.
2. Cooper, R., Crouch, D., van Eijck, J., Fox, C. van Genabith, J., Jaspars, J., Kamp, H., Milward, D., Pinkal, M., Poesio, M. & Pulman, S. (1996). The FraCas Consortium, Deliverable D16. With additional contributions from Briscoe, T., Maier, H. and Konrad, K.
3. Christie, J. R. (1999). Automated essay marking for both content and style. In Proceedings of the 3rd International Computer Assisted Assessment Conference. Loughborough University. Loughborough, UK.
4. Christie, J. R. (2003). Automated essay marking for content-does it work? In Proceedings of the 7th International Computer Assisted Assessment Conference. Loughborough University. Loughborough, UK.
5. Dagan I., Glickman O., & Magnini B. (2005). The PASCAL Recognising Textual Entailment Challenge. In Proceedings of the PASCAL Challenges Workshop on Recognizing Textual Entailment.
6. de Paiva, V. & Holloway King T. (2008). Designing Testsuites for Grammar-based Systems in Applications. In Proceedings of the Coling 2008 Workshop on Gammar Engineering Across Frameworks, pages 49-56.
7. Foltz, P.W., Laham, D. & Landauer, T.K. (2003). Automated essay scoring. Applications to Educational technology. http://www-psych.nmsu.edu/%7Epfoltz/reprints/Edmedia99.html
8. Laham, D., Bennett, W., & Derr, M. (2002). Latent Semantic Analysis for career field analysis and information operations. Paper presented at Interservice/Industry, Simulation and Eduation Conference (I/ITSEC), December 2-5, 2002. Orlando, FL.
9. Larkey, L. S. (1998) Automatic Essay Grading Using Text Categorization Techniques, in Proceedings of SIGIR-98, 21st ACM International Conference on Research and Development in Information Retrieval. ACM Press, 1998.
10. Leacock, C. & Chodorow, M. (2003) C-rater: Automated Scoring of Short-Answer Questions. Computers and Humanities. pp. 389-405.
11. Mason, O. & Grove-Stephenson, I. (2002) Automated free text marking with paperless school. In M. Danson (Ed.), Proceedings of the sixth International Computer Assisted Assessment Conference, Loughborough University, Loughborough, UK.
12. Ming, Y. Mikhailov A., & Kuan T. L. (2000). Intelligent Essay Marking System. Learners Together, NgeeANN Polytechnic, Singapore.
13. Mitchell, T. & Russell, T., Broomhead, P. & Aldridge, N. (2002) Towards robust computerised marking of free-text responses. Proceedings of the 6th International Computer Assisted Assessment Conference.
14. Mohler, M. & Mihalcea R. (2009). Text-to-text Semantic Similarity for Automatic Short Answer Grading. Proceedings of the European Chapter of the Association for Computational Linguistics, Athens, Greece.
15. Prasad, R. & Sarkar A. (2000). Comparing test-suite based evaluation and corpus-based evaluation of a wide-coverage grammar for English. In LREC-00, Athens.
16. Rehder, B. Schreiner, M. E. Wolfe, B. W., Laham, D, and L, T. K., & Kintsch, W. (1998). Using Latent Semantics Analysis to assess knowledge: Some technical considerations. Discourse Processes, 25, 337-354.
17. Rosé, C. P., Roque, A., Bhembe, D. & VanLehn, K. (2003) A hybrid text classification approach for analysis of student essays. Proceedings of the HLT-NAACL 03 Workshop on Educational Applications of NLP.
18. Rudner, L. M., & Liang, T. (2002). Austomated Essay Scoring Using Bayes' Theorem. In Proceedings of the annual meeting of the National Council on Measurement in Eduation.
19. Siddiqi, R. & Harrison, C. (2008). A systematic approach to the automated marking of short answer questions. Multitopic Conference, 2008. INMIC 2008. IEEE International.
20. Sukkarieh, J. Z. & Blackmore, J. (2009). c-rater: Automatic Content Scoring for Short Constructed Responses. Proceedings of the 22nd International Conference for the Florida Aritifical Intelligence Research Society, Florida, USA.
21. Sukkarieh, J. Z., Pulman, S. G. & Raikes, N. (2003). Auto-marking: using computational linguistics to score short, free text responses. Proceedings of the international association of educational assessment, Manchester, UK.
22. Sukkarieh, J. Z. (2001). Natural Language for Knowledge Representation. Ph.D Thesis. University of Cambridge, Cambridge, England.
23. Vanderwende, K. and Dolan W. B. (2006). What Syntax can Contribute in the Entailment Task. In MLCM 2005, LNAI 3944, pp. 205-216. J. Quinonero-Candela et al. (eds., Springer-Verlag).
24. Williams, R. & Dreher, H. (2004). Automatically Grading Essays with Markit©. Proceedings of Informing Science 2004 Conference, Rockhampton, Queensland, Australia, June 25-28, 2004.
25. Wiemer-Hastings, P., Wiemer-Hastings, K. & Graesser, A. (1999). Improving an intelligent tutor's comprehension of students with Latent Semantic Analysis. In S. P. Lajoie and M. vivet, Artificial Intelligence in Education pp. 535-542. Amsterdam: IOS Press.