Predicting word accuracy for the automatic speech recognition of non-native speech

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 773-776

  Yoon, Su Youn ^a   Chen, Lei ^a   Zechner, Klaus ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Non native speakers' speech; Speech recognition; Word accuracy rate

Indexed keywords

SPEECH; SPEECH COMMUNICATION;

AUTOMATIC SPEECH RECOGNITION; BINARY CLASSIFIERS; NON-NATIVE SPEAKERS; NON-NATIVE SPEECH; SPEECH RECOGNITION SYSTEMS; SPEECH RECOGNIZER; STEPWISE REGRESSION; WORD ACCURACIES; ACCURACY RATE; AUTOMATED METHODS; NONNATIVE SPEAKER' SPEECH; PERFORMANCE; WORD ACCURACY RATE;

SPEECH RECOGNITION;

EID: 79959833442     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. K. Zechner, D. Higgins, X. Xi, and D. M. Williamson, "Automatic scoring of non-native spontaneous speech in tests of spoken english," Speech Communication, May 2009.
2. L. Chase, "Word and acoustic confidence annotation for large vocabulary speech recognition," in Proceedings of the European Conference on Speech Communication and Technology, 1997, pp. 815-818.
3. T. J. Hazen, T. Burianek, J. Polifroni, and S. Seneff, "Recognition confidence scoring and its use in speech understanding systems," Computer Speech and Language, pp. 49-67, 2002.
4. D. Litman, J. Hirshberg, and M. Swerts, "Predicting automatic speech recognition performance using prsodic cues," in Proceedings of the 6th International Conference of Spoken Language Processing, 2000.
5. M. Walker, J. Wright, and I. Langkilde, "Using natural language processing and discourse features to identify understanding errors in a spoken dialogue system," in Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann, 2000, pp. 1111-1118.
6. M. Gabsdil, "Combining acoustic and pragmatic features to predict recognition performance in spoken dialogue systems," in Proceedings of ACL, 2004, pp. 344-351.
7. P. Lennon, "Investigating fluency in EFL: A quantitative approach," Language Learning, vol. 40, no. 3, pp. 387-417, 1990.
8. C. Cucchiarini, H. Strik, and L. Boves, "Quantitative assessment of second language learners' fluency: Comparisons between read and spontaneous speech," the Journal of the Acoustical Society of America, vol. 111, no. 6, pp. 2862-2873, 2002. (Pubitemid 34760272)
9. C. Neti, S. Roukos, and E. Eide, "Word-based confidence measures as a guide for stack search in speech recognition," in Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing. IEEE Computer Society, 1997, pp. 883-886.
10. Salton, G., Ed., The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall, 1971.
11. NIST, "The nist speech quality assurance (spqa) package version 2.3," from http://www.nist.gov/speech/tools/index.htm, Retrieved 2009.
12. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The WEKA Data Mining Software: An Update," in SIGKDD Explorations, vol. 11, no. 1, 2009.
13. R. Fish, Q. Hu, and S. Boykin, "Using audio quality to predict word error rate in an automatic speech recognition system," Unpublished 2006 manuscript from The MITRE Corporation.
14. S. Goldwater, D. Jurafsky, and C. Manning, "Which words are hard to recognize? prosodic, lexical, and disfluency factors that increase speech recognition error rates," Speech Communication, pp. 181-200, 2010.