The automatic assessment of free text answers using a modified BLEU algorithm

Computers and Education

Volumn 56, Issue 2, 2011, Pages 337-345

  Noorbehbahani, F ^a   Kardan, A A ^a  

^a AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Adult learning; Evaluation methodologies

Indexed keywords

ADULT LEARNING; ASSESSMENT METHODS; AUTOMATIC ASSESSMENT; BLEU ALGORITHMS; CO-OCCURRENCE; EVALUATION METHODOLOGIES; EVALUATION RESULTS; FREE TEXTS; HUMAN EXPERT; LATENT SEMANTIC ANALYSIS; LEARNING OBJECTIVES; LEARNING PROCESS; SIMILARITY SCORES;

STUDENTS;

ALGORITHMS;

EID: 78149468676     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2010.07.013     Document Type: Article

References (17)

1. Belcadhi, L., Henze, N., & Braham, R. (2004). An assessment framework for eLearning in the semantic web. In: Proceedings of the twelfth GI- workshop on adaptation and user modeling in interactive systems (ABIS 04) (pp. 11-16), Berlin, Germany.
2. Y. He, S.H. Hui, and T.T. Quan Automatic summary assessment for intelligent tutoring systems Computers & Education 53 3 2009 890 899
3. A. Islam, and D. Zaiu Inkpen Semantic text similarity using corpus-based word similarity and string similarity TKDD 2 2 2008 1 25
4. Kakkonen, T., & Sutinen, E. (2004). Automatic assessment of the content of essays based on course materials. In: Proceedings of international conference on information technology: research and education (pp. 126-130).
5. T. Landauer, P. Foltz, and D. Laham Introduction to latent semantic analysis Discours Processes 25 1998 259 284
6. Landauer, T., Laham, D., Rehder, B., & Schreiner, M. E. (1997). How well can passage meaning be derived without using word order? A comparison of latent semantic analysis and humans. In: Proceedings of the 19th annual conference of the cognitive science society.
7. Larkey, L. S. (1998). Automatic essay grading using text categorization techniques. In: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval (pp. 90-95).
8. Lin, C. Y. (2004). ROUGE: A package for automatic evaluation of summaries. In: Proceedings of the workshop on text summarization branches out (WAS 2004) (pp. 74-81), Barcelona, Spain.
9. Lin, C. Y., & Hovy, E. (2003). Automatic evaluation of summaries using n-gram co-occurrence statistics. In: Proceedings of the 2003 conference of the North American chapter of the association for computational linguistics on human language technology (pp. 71-78).
10. Marin, D. P., (2004). Automatic evaluation of users' short essays by using statistical and shallow natural language processing techniques, Master's thesis. Universidad Autónoma de Madrid. http://www.ii.uam.es/ ∼3Adperez/tea.pdf.
11. Mihalcea, R., Corley, C., & Strapparava, C. (2006). Corpus-based and knowledge-based measures of text semantic similarity. In: Proceedings of the american association for artificial intelligence (AAAI 2006) (pp. 775-780).
12. G.A. Miller, C. Fellbaum, R. Tengi, P. Wakefield, R. Poddar, and H. Langone WordNet: A lexical database for the English language 2006 Princeton University Cognitive Science Laboratory Available from http://wordnet.princeton. edu
13. J.R. Moser The electronic assessor - automatic knowledge assessment in the AdeLE e-learning environment 2009 Graz University of Technology
14. Papineni, K., Roukos, S., Ward, T., & Zhu, W. (2002). BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the association for computational linguistics (ACL) (pp. 311-318). Philadelphia.
15. Perez, D., Alfonseca, E., & Rodriguez, P. (2004). Application of the BLEU method for evaluating free-text answers in an e-learning environment. In: Proceedings of the language resources and evaluation conference (LREC- 2004) (pp. 53-65).
16. Perez, D., Gliozzo, A., Strapparava, C., Alfonseca, E., Rodriguez, P., Magnini, B. (2005). In automatic assessment of students' free-text answers underpinned by the combination of a BLEU-inspired algorithm and latent semantic analysis. In: Proceedings of the 18th international Florida artificial intelligence research society conference (FLAIRS'05) (pp. 358-362).
17. P. Wiemer-Hastings Adding syntactic information to LSA Proceedings of the twenty-second conference on cognitive science 2000 Lawrence Erlbaum Associates Mahwah, NJ 989 993