Audiovisual Integration of Speech in a Bistable Illusion

Current Biology

Volumn 19, Issue 9, 2009, Pages 735-739

  Munhall, K G ^a   ten Hove, M W ^a   Brammer, M ^b   Pare M ^a  

^a QUEEN S UNIVERSITY   (Canada)

^b KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

SYSNEURO

Indexed keywords

ARTICLE; ATTENTION; AUDITORY STIMULATION; HUMAN; ILLUSION; PHOTOSTIMULATION; PHYSIOLOGY; SPEECH PERCEPTION; VISION;

ACOUSTIC STIMULATION; ATTENTION; HUMANS; ILLUSIONS; PHOTIC STIMULATION; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 67349193862     PISSN: 09609822     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cub.2009.03.019     Document Type: Article

References (38)

1. Sumby W.H., and Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212-215
2. McGurk H., and MacDonald J. Hearing lips and seeing speech. Nature 264 (1976) 746-748
3. Massaro D.W. Perceiving Talking Faces: From Speech Perception to a Behavioral Principle (1998), MIT Press, Cambridge, MA
4. Musacchia G., Sams M., Nicol T., and Kraus N. Seeing speech affects information processing in the human brainstem. Exp. Brain Res. 168 (2006) 1-10
5. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14 (2002) 115-128
6. Ross L.A., Saint-Amour D., Leavitt V.N., Javitt D.C., and Foxe J.J. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17 (2007) 1147-1153
7. Callan D.E., Jones J.A., Munhall K.G., Kroos C., Callan A., and Vatikiotis-Bateson E. Multisensory-integration sites identified by perception of spatial wavelet filtered visual speech gesture information. J. Cogn. Neurosci. 16 (2004) 805-816
8. Alsius A., Navarra J., Campbell R., and Soto-Faraco S.S. Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15 (2005) 839-843
9. Rubin E. Synoplevde Figurer (1915), Gyldendalske, Kopenhagen
10. Domijan D., and Setic M. A feedback model of figure-ground assignment. J. Vis. 8 (2008) 1-27
11. Peterson M.A., and Skow E. Inhibitory competition between shape properties in figure-ground perception. J. Exp. Psychol. Hum. Percept. Perform. 34 (2008) 251-267
12. Lehmkuhle S., and Fox R. Effect of binocular rivalry suppression on the motion aftereffect. Vision Res. 15 (1976) 855-859
13. Wiesenfelder H., and Blake R. Apparent motion can survive binocular rivalry suppression. Vision Res. 31 (1991) 1589-1600
14. Tuomainen J., Andersen T., Tiippana K., and Sams M. Audio-visual speech perception is special. Cognition 96 (2005) B13-B22
15. Hasson U., Hendler T., Bashat D.B., and Malach R. Vase or face? A neural correlate of shape-selective grouping processes in the human brain. J. Cogn. Neurosci. 13 (2001) 744-753
16. Fox R., and Check R. Detection of motion during binocular rivalry suppression. J. Exp. Psychol. 78 (1968) 388-395
17. Blake R., Yu K., Lokey M., and Norman H. Binocular rivalry and visual motion. J. Cogn. Neurosci. 10 (1998) 46-60
18. Alais D., and Parker A. Independent binocular rivalry processes for form and motion. Neuron 52 (2006) 911-920
19. Sanabria D., Soto-Faraco S., Chan J., and Spence C. Intramodal perceptual grouping modulates multisensory integration: evidence from the crossmodal dynamic capture task. Neurosci. Lett. 377 (2005) 59-64
20. Andrews T.J., Schluppeck D., Homfray D., Matthews P., and Blakemore C. Activity in the fusiform gyrus predicts conscious perception of Rubin's vase-face illusion. Neuroimage 17 (2002) 890-901
21. Paré M., Richler R., ten Hove M., and Munhall K.G. Gaze behavior in audiovisual speech perception: The influence of ocular fixations on the McGurk effect. Percept. Psychophys. 65 (2003) 553-567
22. Tiippana K., Andersen T.S., and Sams M. Visual attention modulates audiovisual speech perception. Eur. J. Cogn. Psychol. 16 (2004) 457-472
23. Soto-Faraco S., and Alsius A. Conscious access to the unisensory components of a cross-modal illusion. Neuroreport 18 (2007) 347-350
24. Bertelson P., Vroomen J., de Gelder B., and Driver J. The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept. Psychophys. 62 (2000) 321-332
25. Foxe J.J., Simpson G.V., and Ahlfors S.P. Cued shifts of intermodal attention: parieto-occipital |10 Hz activity reflects anticipatory state of visual attention mechanisms. Neuroreport 9 (1998) 3929-3933
26. Spence C., and Driver J. Audiovisual links in exogenous covert spatial orienting. Percept. Psychophys. 59 (1997) 1-22
27. Kayser C., Petkov C.I., and Logothetis N.K. Visual modulation of neurons in auditory cortex. Cereb. Cortex 18 (2008) 1560-1574
28. Greenberg S. Speaking in shorthand - A syllable-centric perspective for understanding pronunciation variation. Speech Commun. 29 (1999) 159-176
29. Liberman A.M., Cooper F.S., Shankweiler D.P., and Studdert-Kennedy M. Perception of the speech code. Psychol. Rev. 74 (1967) 431-461
30. Munhall K.G., and Tohkura Y. Audiovisual gating and the time course of speech perception. J. Acoust. Soc. Am. 104 (1998) 530-539
31. Campbell R. The processing of audio-visual speech: empirical and neural bases. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363 (2008) 1001-1010
32. Yehia H.C., Kuratate T., and Vatikiotis-Bateson E. Linking facial animation, headmotion and speech acoustics. J. Phonetics 30 (2002) 555-568
33. Schroeder C.E., Lakatos P., Kajikawa Y., Partan S., and Puce A. Neuronal oscillations and visual amplifications of speech. Trends Cogn. Sci. 12 (2008) 106-113
34. Pressnitzer D., and Hupé J.-M. Temporal dynamics of auditory and visual bistability reveal principles of perceptual organization. Curr. Biol. 16 (2006) 1351-1357
35. Blake R., and Logothetis N.K. Visual competition. Nat. Rev. Neurosci. 3 (2002) 13-21
36. Shams L., Kamitani Y., and Shimojo S. Visual illusion induced by sound. Brain Res. Cogn. Brain Res. 14 (2002) 147-152
37. Robinson D.A. A method of measuring eye movements using a scleral search coil in a magnetic field. IEEE Trans. Biomed. Eng. 10 (1963) 137-145
38. Collewijn H., van der Mark F., and Jansen T.C. Precise recording of human eye movements. Vision Res. 15 (1975) 447-450