Using an Ontology for Improved Automated Content Scoring of Spontaneous Non-Native Speech

Proceedings of the 7th Workshop on Innovative Use of NLP for Building Educational Applications, BEA 2012 at the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2012

Volumn , Issue , 2012, Pages 86-94

  Chen, Miao ^a   Zechner, Klaus ^b  

^a SYRACUSE UNIVERSITY   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS; SPEECH; SPEECH RECOGNITION; SPEECH TRANSMISSION; VECTOR SPACES;

AUTOMATED ESSAY SCORING; COSINE SIMILARITY; FEATURE CORRELATION; NON-NATIVE; NON-NATIVE SPEECH; ONTOLOGY'S; ONTOLOGY-BASED; SPONTANEOUS SPEECH; VECTOR ANALYSIS; WORDNET;

ONTOLOGY;

EID: 84906280237     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Alwan, A., Bai, Y., Black, M., Casey, L., Gerosa, M., Heritage, M., & Wang, S. (2007). A system for technology based assessment of language and literacy in young children: The role of multiple information sources. Proceedings of the IEEE International Workshop on Multimedia signal Processing, Greece.
2. Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater® V. 2. The Journal of Technology, Learning and Assessment, 4(3).
3. Balogh, J., Bernstein, J., Cheng, J., & Townshend, B. (2007). Automatic evaluation of reading accuracy: Assessing machine scores. Proceedings of the ISCASLaTE-2007 Workshop, Farmington, PA, October.
4. Bloehdorn, S., & Hotho, A. (2004). Boosting for text classification with semantic features. Workshop on mining for and from the semantic web at the 10th ACM SIGKDD conference on knowledge discovery and data mining (KDD 2004).
5. Burstein, J. (2003). The E-rater® scoring engine: Automated essay scoring with natural language processing. In M. D. Shermis, Burstein, J.C. (Ed.), Automated essay scoring: A cross-disciplinary perspective (pp. 113-121). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
6. Croft, W. B., Metzler, D., & Strohman, T. (2010). Search engines: Information retrieval in practice. Boston, MA: Addison-Wesley.
7. Cucchiarini, C., Strik, H., & Boves, L. (2000). Quantitative assessment of second language learners’ fluency by means of automatic speech recognition technology. Journal of the Acoustical Society of America, 107(2), 989-999.
8. Cucchiarini, C., Strik, H., & Boves, L. (2002). Quantitative assessment of second language learners' fluency: Comparisons between read and spontaneous speech. Journal of the Acoustical Society of America, 111(6), 2862-2873.
9. Dikli, S. (2006). An overview of automated scoring of essays. The Journal of Technology, Learning and Assessment, 5(1), 1-35.
10. Fellbaum, C. (Ed.). (1998). WordNet: An electronic lexical database. Cambridge, MA: The MIT press.
11. Franco, H., Bratt, H., Rossier, R., Gadde, V. R., Shriberg, E., Abrash, V., & Precoda, K. (2010). EduSpeak: A speech recognition and pronunciation scoring toolkit for computer-aided language learning applications. Language Testing, 27(3), 401-418.
12. Hotho, A., Staab, S., & Stumme, G. (2003a). Ontologies improve text document clustering. Proceedings of the Third IEEE International Conference on Data Mining (ICDM’03).
13. Hotho, A., Staab, S., & Stumme, G. (2003b). Text clustering based on background knowledge (Technical report, no.425.): Institute of Applied Informatics and Formal Description Methods AIFB, University of Karlsruche.
14. Landauer, T. K., Laham, D., & Foltz, P. W. (2003). Automated scoring and annotation of essays with the Intelligent Essay Assessor. In M. D. Shermis, Burstein, J.C. (Ed.), Automated essay scoring: A cross-disciplinary perspective (pp. 87–112). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
15. Larkey, L. S., & Croft, W. B. (2003). A Text Categorization Approach to Automated Essay Grading. In M. D. Shermis & J. C. Burstein (Eds.), Automated Essay Scoring: A Cross-discipline Perspective: Mahwah, NJ, Lawrence Erlbaum.
16. Pedersen, T., Patwardhan, S., & Michelizzi, J. (2004). WordNet:: Similarity: measuring the relatedness of concepts. Proceedings of the Fifth Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL-04).
17. Salton, G., Wong, A., & Yang, C. S. (1975). A vector space model for automatic indexing. Communications of the ACM, 18(11), 613-620.
18. Wikipedia: The free encyclopedia (2011). FL: Wiki-media Foundation, Inc. Retrieved Apr 26, 2012, from http://www.wikipedia.org
19. WordNet 3.0 Reference Manual. (2010). Retrieved Apr 26, 2012 from http://wordnet.princeton.edu/wordnet/documentation/
20. Zechner, K., Higgins, D., Xi, X, & D. M. Williamson (2009). Automatic scoring of non-native spontaneous speech in tests of spoken English. Speech Communication, 51(10), 883-895.
21. Zechner, K., & X. Xi (2008). Towards Automatic Scoring of a Test of Spoken Language with Heterogeneous Task Types. Proceedings of the ACL Workshop on Innovative Use of NLP for Building Educational Applications, Columbus, OH, June.