The stimulus as basis for audiovisual integration

7th International Conference on Spoken Language Processing, ICSLP 2002

Volumn , Issue , 2002, Pages 1457-1460

  Vatikiotis Bateson, Eric ^a   Hill, Harold ^a   Kamachi, Miyuki ^a   Lander, Karen ^b   Munhall, Kevin G ^a,c  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

^c QUEEN S UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO-VISUAL INTEGRATION; HIGHLY-CORRELATED; MULTI-MODAL; NOCV1; SPEECH PRODUCTION; VOCAL-TRACTS;

EID: 85009237885     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. W. H. Sumby and I. Pollack, "Visual contribution to speech intelligibility in noise", Jour. Acous. Soc. Amer., vol. 26, pp. 212-215, 1954.
2. G. Rizzolatti and M. A. Arbib, "Language within our grasp", Trends in Neuroscience, vol. 21, pp. 188-194, 1998.
3. D. E. Callan, J. A. Jones, K. G. Munhall, C. Kroos, A. M. Callan, and E. Vatikiotis-Bateson, "Mirror neuron system activity and audiovisual speech perception", in Eigth International Conference on Functional Mapping of the Human Brain, Sendai, Japan, 2002.
4. A. M. Liberman, F. S. Cooper, D. P. Shankweiler, and M. Studdert-Kennedy, "Perception of the speech code", Psychological Review, vol. 74, pp. 431-461, 1967.
5. J. A. Fodor, The modularity of mind, MIT Press, Cambridge, MA, 1983.
6. M. T. Turvey, R. E. Shaw, and W. M. Mace, "Issues in the theory of action: Degrees of freedom, coordinative structures and coalitions", in Attention and performance, J. Requin, Ed., pp. 557-595. Lawrence Erlbaum Associates, Hillsdale, NJ, 1978.
7. J. J. Gibson, The senses considered as perceptual systems, Houghton Mifflin, Boston, 1966.
8. A. M. Liberman and I. G. Mattingly, "The motor theory of speech perception revised", Cognition, vol. 21, pp. 1-36, 1985.
9. E. Vatikiotis-Bateson, C. Kroos, T. Kuratate, K. G. Munhall, and M. Pitermann, "Task constraints on robot realism: The case of talking heads", in 9th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN 2000), 2000, pp. 352-357.
10. T. Kuratate, H. Yehia, and E. Vatikiotis-Bateson, "Kinematics-based synthesis of realistic talking faces", in International Conference on Auditory-Visual Speech Processing (AVSP'98), 1998, pp. 185-190.
11. K. G. Munhall, JA. Jones, D. E. Callan, T. Kuratate, and E. Vatikiotis-Bateson, "Visual prosody improves auditory speech perception", unpublished manuscript.
12. E. Vatikiotis-Bateson and H. Yehia, "Physiological modeling of facial motion during speech", Trans. Tech. Com. Psycho. Physio. Acous., vol. H-96, no. 65, pp. 1-8, 1996.
13. H. Yehia, P. Rubin, and E. Vatikiotis-Bateson, "Quantitative association of vocal-tract and facial behavior", Speech Communication, vol. 26, no. 1-2, pp. 23-43, 1998.
14. H. Yehia, T. Kuratate, and E. Vatikiotis-Bateson, "Using speech acoustics to drive facial motion", in Proc. ICPhS'99, August 1999, vol. 1, pp. 631-634.
15. E. Vatikiotis-Bateson, K. G. Munhall, M. Hirayama, Y. Kasahara, and H. Yehia, "Physiology-based synthesis of audiovisual speech", in 4th Speech Production Seminar: Models and Data, 1996, pp. 241-244.
16. H. C. Yehia, T. Kuratate, and E. Vatikiotis-Bateson, "Linking facial animation, head motion, and speech acoustics", Journal of Phonetics, in press.
17. U. Hadar, T. J. Steiner, E. C. Grant, and F. C. Rose, "Head movement correlates of juncture and stress at sentence level", Language and Speech, vol. 26, no. 2, pp. 117-129, 1983.
18. V. Bruce and T. Valentine, "Identity priming in the recognition of familiar faces", British Journal of Psychology, vol. 76, pp. 373-383, 1985.