Auditory visual speech processing

EUROSPEECH 2001 - SCANDINAVIA - 7th European Conference on Speech Communication and Technology

Volumn , Issue , 2001, Pages 1153-1156

  Massaro, Dominic W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH; SPEECH PROCESSING;

AUDITORY-VISUAL; HUMAN MACHINE INTERACTION; SPECIAL INTEREST GROUPS; SPEECH SCIENCE;

SPEECH COMMUNICATION;

EID: 85009080413     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. McGurk, H., & MacDonald, J. "Hearing lips and seeing voices", Nature, 264, 746-748, 1976.
2. Massaro, D.W., & Stork, D. G. "Sensory integration and speechreading by humans and machines, " American Scientist, 86, 236-244, 1998.
3. Hutton, C. "Combining auditory and visual stimuli in aural rehabilitation", Volta Review, 61, 316-319, 1959.
4. Campbell, H. W. Phoneme recognition by ear and by eye: A distinctive feature analysis, Unpublished doctoral dissertation, University of Nijmegen, Holland, 1974.
5. Massaro, D. W. Perceiving talking faces: From speech perception to a behavioral principle, MIT Press, Cambridge, Massachusetts, 1998.
6. Campbell, R., Dodd, B., & Burnham, D. (Eds.), Hearing by eye II : Advances in the psychology of speechreading and auditory-visual speech, Psychology Press, Hove, East Sussex, UK, 1998.
7. Massaro, D. W., & Egan, P. B. "Perceiving affect from the voice and the face", Psychonomic Bulletin & Review, 3, 215-221, 1996.
8. Vroomen, J. & de Gelder, B. "The perception of emotions by ear and by eye", Cognition and Emotion, 14, 289-311, 2000.
9. Calvert, G. A.; Campbell, R.; Brammer, M. J. "Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex", Current Biology, 10 (11), 649-657, 2000.
10. Bernstein, L. E., Ponton, C., Auer, E. T. "Is audiovisual speech integration an early perceptual effect? An eventrelated potential study of the McGurk effect", Cognitive Neuroscience Society, New York City, March 25-27, 2001.
11. Stein, B.E. "Neural mechanisms for synthesizing sensory information and producing adaptive behaviors", Exp. Brain Res., 123(1-2):124-35, 2001.
12. Anatasio, T. "Modelling Multisensory Enhancement in the Superior Colliculus: The second annual Multisensory Research Conference, held 6 - 7 October, 2000 in Tarrytown, New York..
13. Petajan, E. D. "Automatic Lipreading to Enhance Speech Recognition: Proceedings of the Global Telecommunications Conference", IEEE Communication Society, 265-272, 1984.
14. Toyama, K. "Prolegomena for Robust Face Tracking: Microsoft Research Technical Report", MSR-TR-98-65, 1998.
15. Gagne, J., Le Monday, K., Desbiens, C., Lapanlme, M. & Ducas, L. "Evaluation of a visual -FM system to enhance speechreading. Proceedings of Auditory Visual Speech Perception, 201-206, Terrigal-Sydney Australia, December, 1998.
16. Ganymedia, http://www.ganymedia.com/.
17. Yang, J., Stiefelhagen, R., Meier, U., & Waibel, A. "Visual tracking for multimodal human computer interaction", Proceedings of SIGCHI, 140-147, 1998.
18. Shpungin, B, & Movellan, J. R. " A multimodular approach to real-Time face tracking", Proceedings of the 7th symposium on Neural Computation, California Institute of Technology, June 2000.
19. Parke, F. I. "A model for human faces that allows speech synchronized animation", Computers and Graphics Journal, 1(1-4), 1975.
20. Massaro, D.W., Cohen, M. M., Beskow, J., & Cole, R. A. "Developing and evaluating conversational agents", In J. Cassell, J. Sullivan, S. Prevost, & E. Churchill (Eds.) Embodied conversational agents, MIT Press, Cambridge, MA, 2000.
21. http://www.msagentring.org/.
22. Yehia, H., Rubin, P., & Vatikiotis-Bateson, E. Quantitative Association of Vocal-Tract and. Speech Communication, 26(1-2):23-43, 1998.
23. Jiang, J., Alwan, A., Bernstein, L. E., Keating, P., & Auer, E. T. "On the correlation between facial movements, tongue movements, and speech acoustics", ICSLP2000, International Congress on Spoken Language Processing, Beijing, China, 16-20 October, 1998.
24. Munhall, K.G., Vatikiotis-Bateson, E. & Tohkura, Y. "X-ray Film database for speech research", Journal of the Acoustical Society of America, 98, 1222-1224, 1995.
25. Westbury, J. R. "X-Ray Microbeam Speech Production Database User's Handbook", Madison, WI: Waisman Center on Mental Retardation and Human Development, 1994.
26. Stone, M. & Lundberg, L. "Three-dimensional tongue surface shapes of English consonants and vowels", Journal of the Acoustical Society of America, 99, 1-10, 1996.
27. Cohen, M. M., Beskow, J., & Massaro, D. W. "Recent developments in facial animation: An inside view", Proceedings of Auditory Visual Speech Perception, 201- 206, Terrigal-Sydney Australia, December, 1998.
28. Waibel, A. "Interactive translation of conversational speech", Computer, 29, 41-48, 1996.
29. Ogata, S., Murai, K., Nakamura, S., & Morishima, S. "Model-based lip synchronization with automatic translated synthetic voice toward a multi-modal translation system", 2001.
30. Eva Agelfors, Jonas Beskow, Bjrn Granstrm, Magnus Lundeberg, Giampiero Salvi, "Synthetic Visual Speech Driven From Auditory Speech", speech.kth.se/~bes...avsp99teleface.pdf.
31. Massaro, D.W., Beskow, J., Cohen, M. M., Fry, C. L., & Rodriguez, T. "Picture my voice: Audio to visual speech synthesis using artificial neural networks", In D. W. Massaro (Ed.), Proceedings of AVSP'99: International Conference on Auditory-Visual Speech Processing, 133- 138, Santa Cruz, CA., August, 1999.
32. Massaro, D.W., & Cole, R. "From 'Speech is special' to talking heads in language learning", In Integrating Speech Technology in the Language Learning and Assistive Interface, University of Abertay Dundee, Dundee, Scotland, August 29-30, 153-161, 2000.
33. Rubin, P. & Vatikiotis-Bateson, E. "Talking heads", In D. Burnham, J. Robert-Ribes, & E. Vatikiotis-Bateson (Eds.), International Conference on Auditory-Visual Speech Processing - AVSP'98, 231-235, Terrigal, Australia, 1998.