Automated Content Scoring of Spoken Responses Containing Multiple Parts with Factual Information

Speech and Language Technology in Education, SLaTE 2013

Volumn , Issue , 2013, Pages 137-142

  Xiong, Wenting ^a   Evanini, Keelan ^b   Zechner, Klaus ^b   Chen, Lei ^b  

^a Learning Research and Development Ctr   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

automated scoring; content appropriateness; spoken language assessment

Indexed keywords

AUTOMATION; VECTOR SPACES;

AUDITORY STIMULI; AUTOMATED SCORING; CONTENT APPROPRIATENESS; FACTUAL INFORMATION; LANGUAGE ASSESSMENT; MULTIPLE PARTS; NON-NATIVE SPEAKERS; SPOKEN LANGUAGE ASSESSMENT; SPOKEN LANGUAGES; TEST RESPONSE;

SPEECH RECOGNITION;

EID: 85026598227     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. P. Price, J. Tepperman, M. Iseli, T. Duong, M. Black, S. Wang, C. Boscardin, M. Heritage, P. David Pearson, S. Narayanan et al., “Assessment of emerging reading skills in young native speakers and language learners,” Speech Communication, vol. 51, no. 10, pp. 968–984, 2009.
2. M. Eskenazi, “An overview of spoken language technology for education,” Speech Communication, vol. 51, no. 10, pp. 832–844, 2009.
3. J. Balogh, J. Bernstein, J. Cheng, and B. Townshend, “Automatic evaluation of reading accuracy: assessing machine scores,” in Proceedings of the ISCA Tutorial and Research Workshop on Speech and Language Technology in Education (SLaTE), 2007, pp. 1–3.
4. S. Xie, K. Evanini, and K. Zechner, “Exploring content features for automated speech scoring,” in Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Montréal, Canada: Association for Computational Linguistics, 2012, pp. 103–111.
5. C. Leacock and M. Chodorow, “C-rater: Automated scoring of short-answer questions,” Computers and the Humanities, vol. 37, no. 4, pp. 385–405, 2003.
6. J. Z. Sukkarieh, S. Pulman, and N. Raikes, “Auto-marking 2: An update on the UCLES-Oxford university research into using computational linguistics to score short, free text responses.” in International Association of Educational Assessment, 2004.
7. S. Pulman and J. Z. Sukkarieh, “Automatic short answer marking,” in Proceedings of the 3rd NAACL-HLT Workshop on Innovative Use of NLP for Building Educational Applications, 2005, pp. 9–16.
8. M. Mohler and R. Mihalcea, “Text-to-text semantic similarity for automatic short answer grading,” in Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, 2009, pp. 567–575.
9. D. Higgins, J. Burstein, and Y. Attali, “Identifying off-topic student essays without topic-specific training data,” Natural Language Engineering, vol. 12, 2006.
10. Y. Attali and J. Burstein, “Automated essay scoring with e-rater v.2.0.” in Presented at the Annual Meeting of the International Association for Educational Assessment, 2004.
11. C. Corley and R. Mihalcea, “Measuring the semantic similarity of texts,” in Proceedings of the ACL Workshop on Empirical Modeling of Semantic Equivalence and Entailment, 2005, pp. 13–18.
12. C. Fellbaum, WordNet: An Electronic Lexical Database. Cambridge, MA: MIT Press, 1998.
13. P. D. Turney, “Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL,” in Proceedings of the Twelfth European Conference on Machine Learning (ECML), Freiburg, Germany, 2001, pp. 491–502.
14. I. Dagan, O. Glickman, and B. Magnini, “The PASCAL recognising textual entailment challenge,” in Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Tectual Entailment, J. Quiñonero-Candela, I. Dagan, B. Magnini, and F. d’Alché Buc, Eds. Springer, 2006, pp. 177–190.
15. M. Mohler, R. Bunescu, and R. Mihalcea, “Learning to grade short answer questions using semantic similarity measures and dependency graph alignments,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 2011, pp. 752–762.
16. F. Huang and L. Chen, “Scoring spoken responses based on content accuracy,” in Proceedings of the 7th Workshop on Innovative Use of NLP for Building Educational Applications, NAACL-HLT. Montréal, Canada: Association for Computational Linguistics, 2012.
17. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, “Large margin methods for structured and interdependent output variables,” Journal of Machine Learning Research, vol. 6, no. 2, p. 1453, 2006.
18. C. Leacock and M. Chodorow, “Combining local context and wordnet similarity for word sense identification,” in WordNet: An Electronic Lexical Database, C. Fellbaum, Ed. MIT Press, 1998, pp. 305–332.
19. K. Zechner, D. Higgins, X. Xi, and D. M. Williamson, “Automatic scoring of non-native spontaneous speech in tests of spoken English,” Speech Communication, vol. 51, no. 10, pp. 883–895, 2009.