Sound alters activity in human V1 in association with illusory visual perception

NeuroImage

Volumn 31, Issue 3, 2006, Pages 1247-1256

  Watkins, S ^a,b   Shams, L ^c   Tanaka, S ^d   Haynes, J D ^a,b   Rees, G ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d JIN AI UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; PERCEPTION; PRIORITY JOURNAL; SOUND; SUPERIOR COLLICULUS; TEMPORAL CORTEX; VISION; VISUAL CORTEX; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ATTENTION; AUDITORY CORTEX; AUDITORY PATHWAYS; AUDITORY PERCEPTION; BRAIN MAPPING; DOMINANCE, CEREBRAL; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NERVE NET; OPTICAL ILLUSIONS; PHOTIC STIMULATION; PSYCHOPHYSICS; RETINA; SUPERIOR COLLICULUS; TEMPORAL LOBE; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 33745016748     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2006.01.016     Document Type: Article

References (68)

1. Amedi A., Malach R., Hendler T., Peled S., and Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 4 (2001) 324-330
2. Arden G.B., Wolf J.E., and Messiter C. Electrical activity in visual cortex associated with combined auditory and visual stimulation in temporal sequences known to be associated with a visual illusion. Vision Res. 43 (2003) 2469-2478
3. Beauchamp M.S. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr. Opin. Neurobiol. 15 (2005) 145-153
4. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., and Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat. Neurosci. 7 (2004) 1190-1192
5. Bermant R.I., and Welch R.B. Effect of degree of separation of visual-auditory stimulus and eye position upon spatial interaction of vision and audition. Percept. Mot. Skills 42 (1976) 487-493
6. Bhattacharya J., Shams L., and Shimojo S. Sound-induced illusory flash perception: role of gamma band responses. NeuroReport 13 (2002) 1727-1730
7. Bolognini N., Frassinetti F., Serino A., and Ladavas E. "Acoustical vision" of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp. Brain Res. 160 (2005) 273-282
8. Boussaoud D., Ungerleider L.G., and Desimone R. Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. J. Comp. Neurol. 296 (1990) 462-495
9. Calvert G.A., and Thesen T. Multisensory integration: methodological approaches and emerging principles in the human brain. J. Physiol. (Paris) 98 (2004) 191-205
10. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C., McGuire P.K., Woodruff P.W., Iversen S.D., and David A.S. Activation of auditory cortex during silent lipreading. Science 276 (1997) 593-596
11. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10 (2000) 649-657
12. Calvert G.A., Hansen P.C., Iversen S.D., and Brammer M.J. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14 (2001) 427-438
13. Clavagnier S., Falchier A., and Kennedy H. Long-distance feedback projections to area V1: implications for multisensory integration, spatial awareness, and visual consciousness. Cogn. Affect. Behav. Neurosci. 4 (2004) 117-126
14. Distler C., Boussaoud D., Desimone R., and Ungerleider L.G. Cortical connections of inferior temporal area TEO in macaque monkeys. J. Comp. Neurol. 334 (1993) 125-150
15. Dougherty R.F., Koch V.M., Brewer A.A., Fischer B., Modersitzki J., and Wandell B.A. Visual field representations and locations of visual areas V1/2/3 in human visual cortex. J. Vis. 3 (2003) 586-598
16. Falchier A., Clavagnier S., Barone P., and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22 (2002) 5749-5759
17. Felleman D.J., and Van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1 (1991) 1-47
18. Fort A., Delpuech C., Pernier J., and Giard M.H. Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res. Cogn. Brain Res. 14 (2002) 20-30
19. Foxe J.J., Wylie G.R., Martinez A., Schroeder C.E., Javitt D.C., Guilfoyle D., Ritter W., and Murray M.M. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol. 88 (2002) 540-543
20. Frassinetti F., Pavani F., and Ladavas E. Acoustical vision of neglected stimuli: interaction among spatially converging audiovisual inputs in neglect patients. J. Cogn. Neurosci. 14 (2002) 62-69
21. Friston K.J., Penny W., Phillips C., Kiebel S., Hinton G., and Ashburner J. Classical and Bayesian inference in neuroimaging: theory. NeuroImage 16 (2002) 465-483
22. Fu K.M., Johnston T.A., Shah A.S., Arnold L., Smiley J., Hackett T.A., Garraghty P.E., and Schroeder C.E. Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 23 (2003) 7510-7515
23. Fu K.M., Shah A.S., O'Connell M.N., McGinnis T., Eckholdt H., Lakatos P., Smiley J., and Schroeder C.E. Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex. J. Neurophysiol. 92 (2004) 3522-3531
24. Ghazanfar A.A., Maier J.X., Hoffman K.L., and Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 25 (2005) 5004-5012
25. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
26. Gondan M., Niederhaus B., Rosler F., and Roder B. Multisensory processing in the redundant-target effect: a behavioral and event-related potential study. Percept. Psychophys. 67 (2005) 713-726
27. Kitagawa N., and Ichihara S. Hearing visual motion in depth. Nature 416 (2002) 172-174
28. Lloyd D.M., Shore D.I., Spence C., and Calvert G.A. Multisensory representation of limb position in human premotor cortex. Nat. Neurosci. 6 (2003) 17-18
29. Macaluso E., Frith C.D., and Driver J. Modulation of human visual cortex by crossmodal spatial attention. Science 289 (2000) 1206-1208
30. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
31. Meredith M.A., and Stein B.E. Interactions among converging sensory inputs in the superior colliculus. Science 221 (1983) 389-391
32. Meredith M.A., Nemitz J.W., and Stein B.E. Determinants of multisensory integration in superior colliculus neurons: I. Temporal factors. J. Neurosci. 7 (1987) 3215-3229
33. Miller J. Divided attention: evidence for coactivation with redundant signals. Cogn. Psychol. 14 (1982) 247-279
34. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn Brain Res. 14 (2002) 115-128
35. Molholm S., Ritter W., Javitt D.C., and Foxe J.J. Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb. Cortex 14 (2004) 452-465
36. Morrell F. Visual system's view of acoustic space. Nature 238 (1972) 44-46
37. Mottonen R., Krause C.M., Tiippana K., and Sams M. Processing of changes in visual speech in the human auditory cortex. Brain Res. Cogn Brain Res. 13 (2002) 417-425
38. Murray M.M., Michel C.M., Grave d.P., Ortigue S., Brunet D., Gonzalez A.S., and Schnider A. Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. NeuroImage 21 (2004) 125-135
39. Murray M.M., Molholm S., Michel C.M., Heslenfeld D.J., Ritter W., Javitt D.C., Schroeder C.E., and Foxe J.J. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 15 (2005) 963-974
40. Olson I.R., Gatenby J.C., and Gore J.C. A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Brain Res. Cogn Brain Res. 14 (2002) 129-138
41. Pekkola J., Ojanen V., Autti T., Jaaskelainen I.P., Mottonen R., Tarkiainen A., and Sams M. Primary auditory cortex activation by visual speech: an fMRI study at 3 T. NeuroReport 16 (2005) 125-128
42. Raij T., Uutela K., and Hari R. Audiovisual integration of letters in the human brain. Neuron 28 (2000) 617-625
43. Reisberg D. Looking where you listen: visual cues and auditory attention. Acta Psychol. (Amst) 42 (1978) 331-341
44. Ress D., and Heeger D.J. Neuronal correlates of perception in early visual cortex. Nat. Neurosci. 6 (2003) 414-420
45. Rockland K.S., and Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol. 50 (2003) 19-26
46. Rockland K.S., and Van Hoesen G.W. Direct temporal-occipital feedback connections to striate cortex (V1) in the macaque monkey. Cereb. Cortex 4 (1994) 300-313
47. Saito D.N., Yoshimura K., Kochiyama T., Okada T., Honda M., and Sadato N. Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study. Cereb. Cortex (2005)
48. Schroeder C.E., and Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol. 15 (2005) 454-458
49. Schroeder C.E., Lindsley R.W., Specht C., Marcovici A., Smiley J.F., and Javitt D.C. Somatosensory input to auditory association cortex in the macaque monkey. J. Neurophysiol. 85 (2001) 1322-1327
50. Schroger E., and Widmann A. Speeded responses to audiovisual signal changes result from bimodal integration. Psychophysiology 35 (1998) 755-759
51. Sekiyama K., Kanno I., Miura S., and Sugita Y. Auditory-visual speech perception examined by fMRI and PET. Neurosci. Res. 47 (2003) 277-287
52. Sekuler R., Sekuler A.B., and Lau R. Sound alters visual motion perception. Nature 385 (1997) 308
53. Sereno M.I., Dale A.M., Reppas J.B., Kwong K.K., Belliveau J.W., Brady T.J., Rosen B.R., and Tootell R.B. Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science 268 (1995) 889-893
54. Shams L., Kamitani Y., and Shimojo S. Illusions. What you see is what you hear. Nature 408 (2000) 788
55. Shams L., Kamitani Y., Thompson S., and Shimojo S. Sound alters visual evoked potentials in humans. NeuroReport 12 (2001) 3849-3852
56. Shams L., Kamitani Y., and Shimojo S. Visual illusion induced by sound. Brain Res. Cogn Brain Res. 14 (2002) 147-152
57. Shams L., Ma W.J., and Beierholm U. Sound-induced flash illusion as an optimal percept. NeuroReport 16 (2005) 1923-1927
58. Stein B.E., Magalhaes-Castro B., and Kruger L. Superior colliculus: visuotopic-somatotopic overlap. Science 189 (1975) 224-226
59. Stein B.E., London N., Wilkinson L., and Price D. Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J. Cogn. Neurosci. 8 (1996) 497-506
60. Sumby WE., and Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212-215
61. Talairach Tournoux. Co-Planar Sterotaxic Atlas of the Human Brain (1988), Theime, Stuggart, Germany
62. Tanabe H.C., Honda M., and Sadato N. Functionally segregated neural substrates for arbitrary audiovisual paired-association learning. J. Neurosci. 25 27 (2005) 6409-6418
63. Teo P.C., Sapiro G., and Wandell B.A. Creating connected representations of cortical gray matter for functional MRI visualization. IEEE Trans. Med. Imaging 16 (1997) 852-863
64. Tong F. Primary visual cortex and visual awareness. Nat. Rev., Neurosci. 4 (2003) 219-229
65. von Kriegstein K., Kleinschmidt A., Sterzer P., and Giraud A.L. Interaction of face and voice areas during speaker recognition. J. Cogn. Neurosci. 17 (2005) 367-376
66. Wallace M.T., Wilkinson L.K., and Stein B.E. Representation and integration of multiple sensory inputs in primate superior colliculus. J. Neurophysiol. 76 (1996) 1246-1266
67. Wallace M.T., Meredith M.A., and Stein B.E. Multisensory integration in the superior colliculus of the alert cat. J. Neurophysiol. 80 (1998) 1006-1010
68. Wandell B.A., Chial S., and Backus B.T. Visualization and measurement of the cortical surface. J. Cogn. Neurosci. 12 (2000) 739-752