Coherence modeling for the automated assessment of spontaneous spoken responses

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 814-819

  Wang, Xinhao ^a   Evanini, Keelan ^a   Zechner, Klaus ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED ASSESSMENT; COHERENCE MODELS; F MEASURE; NON-NATIVE SPEAKERS; PREDICTION ACCURACY; SCORING SYSTEMS; SPOKEN LANGUAGES; SPONTANEOUS SPEECH;

AUTOMATION;

EID: 84906928453     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Yigal Attali and Jill Burstein. 2006. Automated essay scoring with e-rater V. 2. 0. Journal of Technology, Learning, and Assessment. 4(3): 159-174.
2. Regina Barzilay and Lillian Lee. 2004. Catching the drift: Probabilistic content models, with applications to generation and summarization. Proceedings of NAACL-HLT, 113-120.
3. Regina Barzilay and Mirella Lapata. 2005. Modeling local coherence: An entity-based approach. Proceedings of ACL, 141-148.
4. Regina Barzilay and Mirella Lapata. 2008. Modeling local coherence: An entity-based approach. Computational Linguistics, 34(1):1-34.
5. Jill Burstein, Joel Tetreault and Slava Andreyev. 2010. Using entity-based features to model coherence in student essays. Proceedings of NAACL-HLT, 681-684. Los Angeles, California.
6. Lei Chen, Klaus Zechner and Xiaoming Xi. 2009. Improved pronunciation features for constructdriven assessment of non-native spontaneous speech. Proceedings of NAACL-HLT, 442-449.
7. Miao Chen and Klaus Zechner. 2011. Computing and evaluating syntactic complexity features for automated scoring of spontaneous non-native speech. Proceedings of ACL, 722-731.
8. Jian Cheng. 2011. Automatic assessment of prosody in high-stakes English tests. Proceedings of Interspeech, 27-31.
9. Peter W. Foltz, Walter Kintsch and Thomas K. Landauer. 1998. The measurement of textual coherence with Latent Semantic Analysis. Discourse Processes, 25(23):285-307.
10. Arthur C. Graesser, Danielle S. McNamara, Max M. Louwerse and Zhiqiang Cai. 2004. Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36(2):193-202.
11. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann and Ian H. Witten. 2009. The WEKA data mining software: An update. SIGKDD Explorations, 11(1):10-18.
12. Khairun-nisa Hassanali, Yang Liu and Thamar Solorio. 2012. Coherence in child language narratives: A case study of annotation and automatic prediction of coherence. Proceedings of the Interspeech Workshop on Child, Computer and Interaction.
13. Derrick Higgins, Jill Burstein, Daniel Marcu and Claudia Gentile. 2004. Evaluating multiple aspects of coherence in student essays. Proceedings of NAACL-HLT, 185-192.
14. Derrick Higgins, Xiaoming Xi, Klaus Zechner and David Williamson. 2011. A three-stage approach to the automated scoring of spontaneous. Computer Speech and Language, 25:282-306.
15. J. Richard Landis and Gary G. Koch. 1977. The measurement of observer agreement for categorical data. Biometrics, 33(1):159-174.
16. Emily Pitler, Annie Louis and Ani Nenkova. 2010. Automatic evaluation of linguistic quality in multidocument summarization. Proceedings of ACL. 544-554. Uppsala.
17. Helmer Strik and Catia Cucchiarini. 1999. Automatic assessment of second language learners' fluency. Proceedings of the 14th International Congress of Phonetic Sciences, 759-762. Berkeley, CA.
18. Shasha Xie, Keelan Evanini and Klaus Zechner. 2012. Exploring content features for automated speech scoring. Proceedings of NAACL-HLT, 103-111.
19. Helen Yannakoudakis and Ted Briscoe. 2012. Modeling coherence in ESOL learner texts. Proceedings of the 7th Workshop on the Innovative Use of NLP for Building Educational Applications, 33-43. Montreal.
20. Klaus Zechner, Derrick Higgins and Xiaoming Xi. 2007. SpeechRaterSM: A construct-driven approach to scoring spontaneous non-native speech. Proceedings of the International Speech Communication Association Special Interest Group on Speech and Language Technology in Education, 128-131.
21. Klaus Zechner, Derrick Higgins, Xiaoming Xi and David M. Williamson. 2009. Automatic scoring of non-native spontaneous speech in tests of spoken English. Speech Communication, 51(10):883-895.