A multilingual embodied conversational agent for tutoring speech and language learning

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2, Issue , 2006, Pages 825-828

  Massaro, Dominic W ^a   Liu, Ying ^b   Chen, Trevor H ^a   Perfetti, Charles ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Language learning; Speech animation

Indexed keywords

CLIENT SERVER COMPUTER SYSTEMS; COMPUTER AIDED INSTRUCTION; EDUCATION; HUMAN COMPUTER INTERACTION; ONLINE SYSTEMS; STUDENTS; TEACHING;

CLIENT/SERVER ARCHITECTURE; EMBODIED CONVERSATIONAL AGENT; FACE-TO-FACE INTERACTION; HUMAN MACHINE INTERACTION; LANGUAGE LEARNING; PHONOLOGICAL AWARENESS; SCIENCE AND TECHNOLOGY; SPEECH ANIMATION;

SPEECH;

EID: 42149170955     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Massaro, D. W. Symbiotic Value of an Embodied Agent in Language Learning. In Sprague, R.H., Jr. (Ed.), IEEE Proc. of 37th Annual Hawaii Intl. Conference on System Sciences, 2004.
2. Kahler, K., J. Haber, H.-P. Seidel: Geometry-based Muscle Modeling for Facial Animation, Proc. Graphics Interface. 2001.
3. Guenter, B., C. Grimm, D. Wood, H. Malvar and F. Pighin. Making faces. SIGGRAPH, Orlando - USA 55-67. 1998.
4. Bregler, C., Covell, M. & Slaney, M. Video rewrite: Driving visual speech with audio in Proc. of ACM SIGGRAPH 97, 1997.
5. Ezzat, T., G. Geiger and T. Poggio. Trainable videorealistic speech animation ACM Trans. on Graphics, 21(3): 388-398. 2002.
6. Parke, F.I. A model for human faces that allows speech synchronized animation. Journal of Computers and Graphics, 1(1). 1975.
7. Cohen, M. M., & Massaro, D. W. Modeling coarticulation in synthetic visual speech. In N. M. Thalmann & D. Thalmann (Eds.) Models and Techniques in Computer Animation. Springer-Verlag, Tokyo, 1993
8. Beskow, J. Trainable Articulatory Control Models for Visual Speech Synthesis. Journal of Speech Technology, 7(4), to appear.
9. Massaro, D. W. Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MassachuseTtS: MIT Press, 1998
10. Jesse, A., Vrignaud, N., & Massaro, D. W. (2001/01). The processing of information from multiple sources in simultaneous interpreting. Interpreting 5, 95-115.
11. Cohen, M.M. and Massaro, D.W. & Clark R. (2002). Training a talking head. In D.C. Martin (Ed.), Proceedings of the IEEE Fourth International Conference on Multimodal Interfaces, (ICMI'02)(pp. 499-510). Pittsburgh, PA.
12. Massaro, D.W., Ouni, S., Cohen, M.M., & Clark, R. (2005). A Multilingual Embodied Conversational Agent. In R.H. Sprague (Ed.), Proceedings of 38th Annual Hawaii International Conference on System Sciences, (HICCS'05) (CD-ROM,10 pages). Los Alimitos, CA: IEEE Computer Society Press.
13. Bernsen, N.O., Hansen, T.K., Kiilerich, S. and Madsen, T.K.: Field Evaluation of a Single-Word Pronunciation Training System. Proceedings of The Fifth International Conference on Language Resources and Evaluation, LREC 2006, Genova, Italy, May, 2006, 2068-2073.
14. Massaro, D.W. & Light, J. Using visible speech for training perception and production of speech for hard of hearing individuals. Journal of Speech, Language, and Hearing Research, 47(2), 304-320, 2004.
15. Massaro, D.W., & Light, J. (2004). Improving the vocabulary of children with hearing loss. Volta Review, 104(3), 141-174.
16. Bosseler, A. & Massaro, D.W. (2003). Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning for Children with Autism. Journal of Autism and Developmental Disorders, 33(6),653-672.