Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli

Psychonomic Bulletin and Review

Volumn 18, Issue 1, 2011, Pages 123-128

  Kanaya, Shoko ^a   Yokosawa, Kazuhiko ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

Multisensory integration; Speech perception; Ventriloquism

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; ATTENTION; DECISION MAKING; FACIAL EXPRESSION; FEMALE; GESTURE; HUMAN; ILLUSION; MALE; ORIENTATION; PATTERN RECOGNITION; PERCEPTION; SEMANTICS; SOUND DETECTION; SPEECH PERCEPTION; VIDEORECORDING;

ADULT; ASSOCIATION; ATTENTION; CUES; DECISION MAKING; FACIAL EXPRESSION; FEMALE; GESTURES; HUMANS; ILLUSIONS; MALE; ORIENTATION; PATTERN RECOGNITION, VISUAL; PERCEPTUAL MASKING; SEMANTICS; SOUND LOCALIZATION; SPEECH PERCEPTION; VIDEO RECORDING; YOUNG ADULT;

EID: 79951855799     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-010-0027-z     Document Type: Article

References (17)

1. Bertelson, P., & Aschersleben, G. (1998). Automatic visual bias of perceived auditory location. Psychonomic Bulletin & Review, 5, 482-489.
2. Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321-332.
3. Bertelson, P., Vroomen, J., Wiegeraad, G., & de Gelder, B. (1994). Exploring the relation between McGurk interference and ventriloquism. Proceedings of the International Conference on Spoken Language Processing, 2, 559-562. Yokohama.
4. Brungart, D. S., Kordik, A. J., & Simpson, B. D. (2005). Audio and visual cues in a two-talker divided attention speech-monitoring task. Human factors. The Journal of the Human Factors and Ergonomics Society, 47, 562-573. doi:10.1518/001872005774860023
5. Colin, C., Radeau, M., Deltenre, P., & Morais, J. (2001). Rules of intersensory integration in spatial scene analysis and speech reading. Psychologica Belgica, 41, 131-144.
6. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381, 66-68. doi:10.1038/381066a0
7. Jack, C. E., & Thurlow, W. R. (1973). Effects of degree of visual association and angle of displacement on the ventriloquism effect. Perceptual and Motor Skills, 37, 967-979.
8. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
9. Paré, M., Richler, R. C., Ten Hove, M., & Munhall, K. G. (2003). Gaze behavior in audiovisual speech perception: The influence of ocular fixations on the McGurk effect. Perception & Psychophysics, 65, 553-567.
10. Radeau, M. (1985). Signal intensity, task context, and auditory-visual interaction. Perception, 14, 571-577.
11. Radeau, M., & Bertelson, P. (1977). Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations. Perception & Psychophysics, 22, 137-146.
12. Roseboom, W., Nishida, N., & Arnold, D. H. (2009). The sliding window of audio-visual simultaneity. Journal of Vision, 9(12), 1-8. doi:10.1167/9.12.4
13. Sekiyama, K. (1997). Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception & Psychophysics, 59, 73-80.
14. Sekiyama, K., & Tohkura, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. The Journal of the Acoustical Society of America, 90, 1797-1805.
15. Sekiyama, K., & Tohkura, Y. (1994). Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility. Journal of the Acoustical Society of Japan (E), 15, 143-158.
16. Vroomen, J., & de Gelder, B. (2004). Perceptual effects of crossmodal stimulation: Ventriloquism and the freezing phenomenon. In G. Calvert, C. Spence, & B. Stein (Eds.), The handbook of multisensory processes (pp. 141-150). Cambridge MA: MIT Press.
17. Vroomen, J., Bertelson, P., & de Gelder, B. (2001). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63, 651-659.