Effects of automated transcription quality on non-native speakers' comprehension in real-time computer-mediated communication

Conference on Human Factors in Computing Systems - Proceedings

Volumn 3, Issue , 2010, Pages 1725-1734

  Pan, Yingxin ^a   Jiang, Danning ^a   Yao, Lin ^b   Picheny, Michael ^c   Qin, Yong ^a  

^a IBM CHINA RESEARCH LAB   (China)

^b INSTITUTE OF PSYCHOLOGY   (China)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

automated speech recognition; cmc; experiment; non native speakers; real time transcription

Indexed keywords

AUTOMATED SPEECH RECOGNITION; COMPREHENSION PERFORMANCE; CRITICAL POINTS; EXPERIMENTAL DESIGN; LOWER BOUNDS; NON-NATIVE SPEAKERS; REAL-TIME COMMUNICATION; REAL-TIME COMPUTER; STATE-OF-THE-ART SYSTEM; SUBJECTIVE EVALUATIONS; SYSTEM DEVELOPMENT AND DESIGNS; SYSTEM IMPACT; WORD ERROR RATE;

AUTOMATION; EQUATIONS OF STATE; EXPERIMENTS; HUMAN ENGINEERING; TRANSCRIPTION;

SPEECH RECOGNITION;

EID: 77953984526     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1753326.1753584     Document Type: Conference Paper

References (22)

1. Chen, S., Kingsbury, B., Mangu, L., et al. Advances in Speech Transcription at IBM under the DARPA EARS Program. IEEE Transactions on Audio, Speech, and Language Processing 14, 5 (2006), 1596-1608.
2. Cui, X., Gu, L., Xiang, B., et al. Developing High Performance ASR in the IBM Multilingual Speech-to-Speech Translation System. In Proc. ICASSP 2008 (International Conference on Acoustics, Speech, and Signal Processing), IEEE Press (2008), 5121-5124.
3. Gales, M. J.F. Maximum Likelihood Linear Transformations for HMM-based Speech Recognition. Computer Speech and Language, 12 (1998), 75-98. (Pubitemid 128383747)
4. th Conference of the European Chapter of the ACL, 345-353.
5. Jin Y., Psychological Measurement. East China Normal University Press, China, 2005.
6. Kaiser, E.C., Barthelmess, P., Erdmann, C., et al. Multimodal Redundancy across Handwriting and Speech During Computer Mediated Human-Human Interactions. In Proc. ACM SIG'CHI 2007, ACM Press (2007), 1009-1018.
7. Kheir, R and Way, T. Inclusion of Deaf Students in Computer Science Classes Using Real-time Speech Transcription. In Proc. ITiCSE 2007 (Annual Conference on Innovation and Technology in Computer Science Education), ACM Press (2007), 261-265.
8. Lau, R., Rosenfeld, R., and Roukos, S. Adpative Language Modeling Using the Maximum Entropy Principle. In Proc. the ARPA Workshop on Human Language Technology 1993, 108-113.
9. Leith, D. and MacMilan, T. Liberated Learning Initiative Innovation Technology and Inclusion: Current Issues and Future Directions for Liberated Learning Research. Year III Report, 2003 Saint Mary's University, Nova Scotia.
10. Munteanu, C., Baecker, R., Penn, G., et al. The Effect of Speech Recognition Accuracy Rates on the Usefulness and Usability of Webcast Archives. In Proc. ACM SIG'CHI 2006, ACM Press (2006), 493-502.
11. Nakamura, S., Markov, K., Nakaiwa, H., et al. The ATR Multilingual Speech-to-Speech Translation System. IEEE Transactions on Audio, Speech, and Language Processing 10, 2 (2006), 365-376.
12. Pan, Y., Jiang, D., Picheny, M., et al. Effects of Real-time Transcription on Non-native Speaker's Comprehension in Computer-mediated Communications. In Proc. ACM SIG'CHI 2009, ACM Press (2009), 2353-2356.
13. Ramabhadran, B., Siohan, O., and Sethy, A. The IBM 2007 Speech Transcription System for European Parliamentary Speeches. In Proc. ASRU 2007 ( the Automatic Speech Recognition and Understanding Workshop), IEEE Press (2007), 472-477.
14. Sanders, G.A. and LE, A.N. Effects of Speech Recognition Accuracy on the Performance of DARPA Communicator Spoken Dialogue Systems. International Journal of Speech Technology 7 (2004), 293-309.
15. Shi, Q., Chu, S.M., Liu, W. et al. Search and Classification Based Language Model Adaptation. In Proc. Interspeech 2008 (Annual Conference of the International Speech Communication Association).
16. Stark, L., Whittaker, S., and Hirschberg, J. ASR Satisficing: The Effects of ASR Accuracy on Speech Retrieval. In Proc. of ICSLP 2000 (International Conference on Spoken Language Processing).
17. Stolcke, A., Anguera, X., Boakye, K., et al. The SRIICSI Spring 2007 Meeting and Lecture Recognition System. Lecture Notes in Computer Science, Springer (2008).
18. Tong, K. A. The effects of question type, question position, text length and answer location on ESL listening tests. Exploring Language. Hong Kong: Language Center, Hong Kong University of Science and Technology.
19. Tyler, M.D. The Effect of Background Knowledge on First and Second Language Comprehension Difficulty. In Proc. ICSLP 1998 (International Conference on Spoken Language Processing.)
20. Uebel, L.F. and Woodland, P.C. Speaker Adaptation Using Lattice-based MLLR. In Proc. ITRW on Adaptation Methods for Speech Recognition, 2001.
21. Wald, M. Using Automatic Speech Recognition to Enhance Education for All Students: Turning a Vision into Reality. In Proc. ASEE/IEEE Frontiers in Education Conference, S3G-22-25.
22. Woodland, P.C., Pye, D., and Gales, M.J.F. Iterative Unsupervised Adaptation Using Maximum Likelihood Linear Regression. In Proc. ICSLP 1996 (International Conference on Spoken Language Processing), 1133-1136.