Audiovisual synthesis of exaggerated speech for corrective feedback in computer-assisted pronunciation training

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 8218-8222

  Zhao, Junhong ^a,b   Yuan, Hua ^c   Leung, Wai Kim ^d   Meng, Helen ^d   Liu, Jia ^c   Xia, Shanhong ^a  

^a IECAS   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c TSINGHUA UNIVERSITY   (China)

^d CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Computer assisted pronunciation training; exaggerated feedback; visual speech synthesis

Indexed keywords

ACOUSTIC FEATURES; COMPUTER ASSISTED; CORRECTIVE FEEDBACKS; KEY ACTIONS; LANGUAGE LEARNING; PRONUNCIATION TRAININGS; SECOND LANGUAGE; VISUAL SPEECH;

AUDIO ACOUSTICS; SIGNAL PROCESSING; SPEECH SYNTHESIS;

CONTINUOUS SPEECH RECOGNITION;

EID: 84890443373     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639267     Document Type: Conference Paper

References (11)

1. A. Neri, C. Cucchiarini, and H. Strik, "Feedback in computer assisted pronunciation training: technology push or demand pull?," in Proc. ICSLP, pp. 1209-1212, 2002b.
2. R. Akahane-Yamada, Y. Tohkura, A. R. Bradlow, and D. B. Pisoni, "Does training in speech perception modify speech production," in Proc. ICSLP, pp. 606-609, 1996.
3. Y. Tsubota, T. Kawahara, and M. Dantsuji, "Recognition and verification of english by japanese students for computer-assisted language learning system," in Proc. Interspeech, pp. 1205-1208, 2002.
4. Y. Tsubotay, M. Dantsujiz, and T. Kawaharay, "Computer-assisted english vowel learning system for japanese speakers using cross language fomant structuers," in Proc. ICSLP, pp. 566-569, 3 2000.
5. Y. Iribe, S. Manosavanh, K. Katsurada, and T. Nitta, "Generating animated pronunciation from speech through articulatory feature extraction," in Proc. Interspeech, pp. 1617-1621, 2011.
6. Y. Iribe, S. Manosavanh, K. Katsurada, R. Hayashi, C. Zhu, and T. Nitta, "Improvement of animated articulatory gesture extracted from speech for pronunciation training," in Proc. ICASSP, pp. 5133-5136, 2012.
7. J. Lu, R.Wang, L. C. D. Silva, Y. Gao, and J. Liu, "Castle: A computer-assisted stress teaching and learning environment for learners of english as a second language.," in Proc. Interspeech, pp. 606-609, 2010.
8. J. Lu, R. Wang, and L. C. D. Silva, "Automatic stress exaggeration by prosody modification to assist language learners perceive sentence stress," International journal of speech technology, vol. 15, no. 2, pp. 87-98, 2012.
9. K. H.Wong,W. K. Leung,W.K. Lo, and H. Meng, "Development of an articulatory visual-speech synthesizer to support language learning," in Proc. ISCSLP, pp. 139-143, 2010.
10. K. H. Wong, W. K. Lo, and H. Meng, "Allophonic variations in visual speech synthesis for corrective feedback in capt," in Proc. ICASSP, pp. 5708-5711, 2011.
11. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based f0 extraction: Possible role of a repetitive structure in sounds," Speech Communication, vol. 27, no. 3-4, pp. 187-207, 1999.