Training Baldi to be multilingual: A case study for an Arabic Badr

Speech Communication

Volumn 45, Issue 2, 2005, Pages 115-137

  Ouni, Slim ^a,b   Cohen, Michael M ^a   Massaro, Dominic W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b LORIA   (France)

Author keywords

Arabic; Auditory; Avatar; Multilingual; Talking head; Text to speech; Visible and visual speech synthesis

Indexed keywords

ANIMATION; MAN MACHINE SYSTEMS; SPEECH COMMUNICATION; SPEECH PROCESSING; SPURIOUS SIGNAL NOISE;

ARABIC; AUDITORY; AVATAR; MULTILINGUAL SYSTEM; TALKING HEAD; TEXT-TO-SPEECH; VISIBLE AND VISUAL SPEECH SYNTHESIS;

SPEECH SYNTHESIS;

EID: 13544256250     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.11.008     Document Type: Article

References (42)

1. S. Al-Ani Arabic Phonology, An Acoustical and Physiological Investigation 1970 Mouton The Hague
2. L. Ali, and R. Daniloff A contrastive cinefluorographic investigation of the articulation of emphatic/non-emphatic cognate consonants Studia Linguistica 26 2 1972 81 105
3. Bagein, M., Dutoit, T., Malfrere, F., Pagel, V., Ruelle, A., Tounsi, N., 2000. The EULER Project: an Open, Generic, Multi-lingual and Multi-Platform Text-To-Speech System. Paper presented at the ProRISC'2000, Veldhoven
4. L.J. Barker Computer-assisted vocabulary acquisition: The CSLU vocabulary tutor in oral-deaf education Journal of Deaf Studies and Deaf Education 8 2003 187 198
5. L.E. Bernstein, and S.P. Eberhardt Johns Hopkins lip-reading corpus videodisk set 1986 The Johns Hopkins University Baltimore, MD
6. Beutnagel, M., Conkie, A., Schroeter, J., Stylianou, Y., Syrdal, A., 1999. The AT&T Next Gen TTS System. In: Joint Meeting of ASA, EAA and DAGA. http://www.naturalvoices.att.com/
7. V. Blanz, C. Basso, T. Poggio, and T. Vetter Reanimating faces in images and video P. Brunet D. Fellner Proceedings of EUROGRAPHICS 2003 2003 Granada, Spain, 2003
8. A. Bosseler, and D.W. Massaro Development and evaluation of a computer-animated tutor for vocabulary and language learning for children with autism Journal of Autism and Developmental Disorders 33 6 2003 653 672
9. Bregler, C., Covell, M., Slaney, M., 1997. Video rewrite: driving visual speech with audio. In: Proceedings of ACM SIGGRAPH 97
10. P.I. Breslaw, A.J. Griffiths, D.J. Wood, and C.I. Howarth The referential communication skills of deaf children from different educational environments Journal of Child Psychology 22 1981 269 282
11. E.S. Chuang, H. Deshpande, and C. Bregler Facial Expression Space Learning Proceedings of Pacific Graphics 2002 68 76
12. Cohen, M.M., Beskow, J., Massaro, D.W., 1998. Recent developments in facial animation: an inside view. In: ETRW on Auditory-Visual Speech Processing. Terrigal-Sydney, Australia, pp. 201-206
13. M.M. Cohen, and D.W. Massaro Modeling coarticulation in synthetic visual speech Models and Techniques D. Thalmann N. Magnenat-Thalmann Computer Animation 1993 Springer-Verlag Tokyo 141 155
14. Cohen, M.M., Massaro, D.W., Clark, R., 2002. Training a talking head. In: Proceedings of ICMI'02, IEEE Fourth International Conference on Multimodal Interfaces. 14-16 October, Pittsburgh, Pennsylvania
15. M.M. Cohen, R.L. Walker, and D.W. Massaro Perception of synthetic visual speech D.G. Stork M.E. Hennecke Speechreading by Humans and Machines: Models, Systems, and Applications 1996 Springer Germany 53 168
16. Cosi, P., Cohen, M.M., Massaro, D.W., 2002. Baldini: Baldi speaks Italian. Seventh International Conference on Spoken Language Processing (ICSLP 2002), Denver, Colorado
17. H. Davis, and S.R. Silverman Hearing and Deafness fourth ed. 1978 Holt, Rinehart and Winston New York
18. A.M. Elgendy Aspects of Pharyngeal Coarticulation 2001 University of Amsterdam The Netherlands, Amsterdam
19. Ezzat, T., Poggio, T., 1998. MikeTalk: A Talking Facial Display Based on Morphing Visemes, Tony Ezzat and Tomaso Poggio, Proceedings of the Computer Animation Conference. Philadelphia, PA, June 1998
20. T. Ezzat, G. Geiger, and T. Poggio Trainable videorealistic speech animation ACM Transactions on Graphics 21 3 2002 388 398
21. W.H.T. Gairdner The Phonetics of Arabic: A Phonetic Inquiry and Practical Manual for the Pronounciation of Classical Arabic and of one Colloquial: (the Egyptian) Humphrey Milford 1925 Oxford University Press
22. Ghazali, S., 1977. Back Consonants and Backing Coarticulation in Arabic. The university of Texas at Austin, Austin
23. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin Making faces SIGGRAPH, Orlando-USA 1998 55 67
24. Holt, J.A., Traxler, C.B., Allen, T.E., 1997. Interpreting the Scores: A User's Guide to the Ninth Edition Stanford Achievement Test for Educators of Deaf and Hard-of-hearing Students. Gallaudet Research Institute, Washington, DC
25. X.D. Huang Spoken language technology research at microsoft Journal of the Acoustical Society of America 103 5 1998 2815 2816
26. Jakobson, R., 1962. "Mofaxxama", the emphatic phonemes in Arabic. Jakobson, R., Selected Writings, Vol. 1. Mouton and Co, The Hague, pp. 510-522
27. A. Jesse, N. Vrignaud, M.M. Cohen, and D.W. Massaro The processing of information from multiple sources in simultaneous interpreting Interpreting 5 2 2000 95 115
28. K. Kähler, J. Haber, and H.-P. Seidel Geometry-based Muscle Modeling for Facial Animation Proceedings of the Graphics Interface 2001 7-9 2001 37 46
29. Klatt, D., 1987. Journal of the Acoustical Society of America (Review of text-to-speech conversion) 82, 737-793
30. M. Lindau, and P. Ladefoged Variability of Feature Specifications J. Perkell D. Klatt Invariance and Variability in Speech Processes 1983 Lawrence Erlbaum Associates, Inc. New Jersey 464 479
31. D.W. Massaro Perceiving Talking Faces: From Speech Perception to a Behavioral Principle 1998 MIT Press Cambridge, MA
32. D.W. Massaro Symbiotic value of an embodied agent in language learning Proceedings of the Thirty-Seventh Annual Hawaii International Conference on System sciences 2004 IEEE Computer Society
33. Massaro, D.W., Bosseler, A., Light, J., 2003. Development and evaluation of a computer-animated tutor for language and vocabulary learning. Fifteenth International Congress of Phonetic Sciences (ICPhS '03), Barcelona, Spain
34. D.W. Massaro, M.M. Cohen, and J. Beskow Developing and evaluating conversational agents J. Cassell J. Sullivan S. Prevost E. Churchill Embodied Conversational Agents 2000 MIT Press Cambridge, MA 286 318
35. Massaro, D.W., Cohen, M.M., Tabain, M., Beskow, J., Clark, R., (in press). Animated speech: Research progress and applications. In: Vatiokis-Bateson, E., Bailly, G., Perrier, P. (Eds.), Audiovisual Speech Processing. MIT Press, Massachusetts
36. Massaro, D.W., Light, J., 2003. Read my tongue movements: Bimodal learning to perceive and produce non-native speech /r/ and /l/. Eurospeech 2003-Switzerland (Interspeech). Eighth European Conference on Speech Communication and Technology, Geneva, Switzerland
37. D.W. Massaro, and J. Light Improving the vocabulary of children with hearing loss Volta Review 104 3 2004 141 174
38. D.W. Massaro, and J. Light Using visible speech for training perception and production of speech for hard of hearing individuals Journal of Speech, Language, and Hearing Research 47 2 2004 304 320
39. F.I. Parke A model for human faces that allows speech synchronized animation Journal of Computers and Graphics 1 1 1975 1 4
40. R. Sproat Multilingual Text-to-Speech Synthesis: The Bell Labs Approach 1997 Kluwer Academic Publishers Boston
41. W.H. Sumby, and I. Pollack Visual contribution to speech intelligibility in noise Journal of Acoustic Society of America 26 1954 212 215
42. Taylor, P., Black, A.W., 1997. The Festival Speech Synthesis System: System Documentation. Human Communication Research Centre, University of Edinburgh, Scotland, UK