Visual recalibration of auditory spatial perception: Two separate neural circuits for perceptual learning

European Journal of Neuroscience

Volumn 30, Issue 6, 2009, Pages 1141-1150

  Passamonti, Claudia ^a,b   Frissen, Ilja ^c   Làdavas, Elisabetta ^a,b  

^a UNIVERSITY OF BOLOGNA   (Italy)

^b CsrNC Centro di Studi e Ricerche in Neuroscienze Cognitive   (Italy)

^c MCGILL UNIVERSITY   (Canada)

Author keywords

Hemianopia; Neglect; Plasticity; Ventriloquism after effect; Visual awareness

Indexed keywords

ADAPTATION; ADULT; AGED; ARTICLE; AUDITORY STIMULATION; BRAIN CORTEX LESION; DEPTH PERCEPTION; FEMALE; FORCED CHOICE METHOD; HEARING; HEMIANOPIA; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NEGLECT; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE TRACT; PARIETAL LOBE; PRIORITY JOURNAL; SPATIAL DISCRIMINATION; STRIATE CORTEX; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AGED; ANALYSIS OF VARIANCE; ATTENTION; AUDITORY PERCEPTION; CHOICE BEHAVIOR; CORPUS STRIATUM; FEMALE; GENICULATE BODIES; HEMIANOPSIA; HUMANS; LEARNING; MALE; MIDDLE AGED; NEURAL PATHWAYS; PERCEPTUAL DISORDERS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SPACE PERCEPTION; TECTUM MESENCEPHALI; VISUAL PERCEPTION;

EID: 70349206337     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2009.06910.x     Document Type: Article

References (64)

1. Bajo, V.M., Nodal, F.R., Bizley, J.K., Moore, D.R. King, A.J. (2006) The ferret auditory cortex: descending projections to the inferior colliculus. Cereb. Cortex, 17, 475 491.
2. Bernstein, L.E., Auer, E.T. Jr., Moore, J.K., Ponton, C.W., Don, M. Singh, M. (2002) Visual speech perception without primary auditory cortex activation. Neuroreport, 13, 311 315.
3. Bertelson, P. (1993) The Time-Course of Adaptation to Auditory-Visual Spatial Discrepancy. Paper presented at the 6th conference of the European Society for Cognitive Psychology, Copenhagen, Denmark.
4. Bertelson, P. Radeau, M. (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys., 29, 578 587.
5. Bertelson, P., Pavani, F., Ladavas, E., Vroomen, J. de Gelder, B. (2000) Ventriloquism in patients with unilateral visual neglect. Neuropsychologia, 38, 1634 1642.
6. Bertelson, P., Frissen, I., Vroomen, J. de Gelder, B. (2006) The aftereffects of ventriloquism: patterns of spatial generalization. Percept. Psychophys., 68, 428 436.
7. Bizley, J.K., Nodal, F.R., Bajo, V.M., Nelken, I. King, A.J. (2007) Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb. Cortex, 17, 2172 2189.
8. Bolognini, N., Leo, F., Passamonti, C., Stein, B.E. Ladavas, E. (2007) Multisensory-mediated auditory localization. Perception, 36, 1477 1485.
9. Bonath, B., Noesselt, T., Martinez, A., Mishra, J., Schwiecker, K., Heinze, H.J. Hillyard, S.A. (2007) Neural basis of the ventriloquist illusion. Curr. Biol., 17, 1697 1703.
10. Brainard, M.S. Knudsen, E.I. (1993) Experience-dependent plasticity in the inferior colliculus: a site for visual calibration of the neural representation of the barn owl. J. Neurosci., 13, 4589 4608.
11. Budinger, E., Heil, P., Hess, A. Scheich, H. (2006) Multisensory processing via early cortical stages: connections of the primary auditory cortical field with other sensory systems. Neuroscience, 143, 1065 1083.
12. Burnett, L.R., Stein, B.E., Chaponis, D. Wallace, M.T. (2004) Superior colliculus lesions preferentially disrupt multisensory orientation. Neuroscience, 124, 535 547.
13. Calvert, G.A. Campbell, R. (2003) Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci., 15, 57 70.
14. Calvert, G.A., Brammer, M.J., Bullmore, E.T., Campbell, R., Iversen, S.D. David, A.S. (1999) Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport, 10, 2619 2623.
15. Canon, L.K. (1970) Intermodality inconsistency of input and directed attention as determinants of the nature of adaptation. J. Exp. Psychol., 84, 141 147.
16. Frassinetti, F., Bolognini, N. Ladavas, E. (2002) Enhancement of visual perception by crossmodal audio-visual interaction. Exp. Brain Res., 147, 332 343.
17. Frassinetti, F., Bolognini, N., Bottari, D., Bonora, A. Ladavas, E. (2005) Audiovisual integration in patients with visual deficit. J. Cogn. Neurosci., 17, 1442 1452.
18. Frissen, I. (2005) Visual Recalibration of Auditory Spatial Perception. Unpublished PhD thesis. Tilburg University, Tilburg, the Netherlands.
19. Frissen, I., Vroomen, J., de Gelder, B. Bertelson, P. (2003) The aftereffects of ventriloquism: are they sound-frequency specific? Acta Psychol., 113, 315 327.
20. Gauthier, L., Dehaut, F. Joanette, Y. (1989) The Bells test: a quantitative and qualitative test for visual neglect. Int. J. Clin. Neuropsychol., 11, 49 54.
21. Ghazanfar, A.A., Maier, J.X., Hoffman, K.L. Logothetis, N.K. (2005) Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci., 25, 5004 5012.
22. Ghazanfar, A.A., Chandrasekaran, C. Logothetis, N.K. (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J. Neurosci., 28, 4457 4469.
23. Giard, M.H. Peronnet, F. (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci., 11, 473 490.
24. Hackett, T.A., De La Mothe, L.A., Ulbert, I., Karmos, G., Smiley, J. Schroeder, C.E. (2007) Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane. J. Comp. Neurol., 502, 924 952. (Pubitemid 46806628)
25. Heilman, K.M. Valenstein, E. (1979) Mechanisms underlying hemispatial neglect. Ann. Neurol., 5, 166 170.
26. Held, R. (1965) Plasticity in sensory-motor systems. Sci. Am., 213, 84 94.
27. Howard, I.P. Templeton, W.B. (1966) Human Spatial Orientation. Wiley, New York.
28. Knudsen, E.I. (1999) Mechanisms of experience-dependent plasticity in the auditory localization pathway of the barn owl. J. Comp. Physiol., 185, 305 312.
29. Konishi, M. (1986) Centrally synthesized maps of sensory space. Trends Neurosci., 9, 163 168.
30. Làdavas, E. (2008) Multisensory-based approach to the recovery of unisensory deficit. Ann. NY Acad. Sci., 1124, 98 110.
31. Lakatos, P., Chen, C.M., O'Connell, M.N., Mills, A. Schroeder, C.E. (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron, 53, 279 292.
32. Lehmann, C., Herdener, M., Esposito, F., Hubl, D., di Salle, F., Scheffler, K., Bach, D.R., Federspiel, A., Kretz, R., Dierks, T. Seifritz, E. (2006) Differential patterns of multisensory interactions in core and belt areas of human auditory cortex. Neuroimage, 31, 294 300.
33. Leo, F., Bolognini, N., Passamonti, C., Stein, B.E. Làdavas, E. (2008) Cross-modal localization in hemianopia: new insights on multisensory integration. Brain, 131, 855 865.
34. Lewald, J. (2002) Rapid adaptation to auditory-visual spatial disparity. Learn. Mem., 9, 268 678.
35. Luksch, H., Gauger, B. Wagner, H. (2000) A candidate pathway for a visual instructional signal to the barn owl's auditory system. J. Neurosci., 20, 1 4.
36. Martuzzi, R., Murray, M.M., Michel, C.M., Thiran, J.P., Maeder, P.P., Clarke, S. Meuli, R.A. (2006) Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb. Cortex, 17, 1672 1679.
37. Meredith, M.A. Stein, B.E. (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res., 365, 350 354.
38. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E. Foxe, J.J. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res., 14, 115 128.
39. Ohl, F.W. Scheich, H. (2005) Leaning-induced plasticity in animal and human auditory cortex. Curr. Opin. Neurobiol., 15, 470 477.
40. Passamonti, C., Bertini, C. Làdavas, E. (2009) Audio-Visual training improves oculomotor patterns in hemianopia. Neuropsychologia, 47, 546 555.
41. Pekkola, J., Ojanen, V., Autti, T., Jääskeläinen, I.P., Möttönen, R., Tarkiainen, A. Sams, M. (2005) Primary auditory cortex activation by visual speech: an fMRI study at 3T. Neuroreport, 16, 125 128.
42. Radeau, M. (1992) Cognitive impenetrability in auditory-visual interaction. In Alegria, J., Holender, D., Morais, J. Radeau, M. (Eds Analytic Approaches to Human Cognition. Elsevier, Amsterdam, pp. 41 55.
43. Radeau, M. (1994) Auditory-visual spatial interaction and modularity. Curr. Psychol. Cogn., 13, 3 51.
44. Radeau, M. Bertelson, P. (1974) The after-effects of ventriloquism. Q. J. Exp. Psychol., 26, 63 71.
45. Radeau, M. Bertelson, P. (1976) The effect of a textured field on modality dominance in a ventriloquism situation. Percept. Psychophys., 20, 227 235.
46. Recanzone, G.H. (1998) Rapidly induced auditory plasticity: the ventriloquism aftereffect. Proc. Natl Acad. Sci. USA, 95, 869 875.
47. Rockland, K.S. Ojima, H. (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol., 50, 19 26.
48. Sarlat, L., Warusfel, O. Viaud-Delmon, I. (2006) Ventriloquism aftereffects occur in the rear hemisphere. Neurosci. Lett., 404, 324 329.
49. Schroeder, C.E. Foxe, J.J. (2002) The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res., 14, 187 198.
50. Schroeder, C.E., Smiley, J., Fu, K.G., McGinnis, T., O'Connell, M.N. Hackett, T.A. (2003) Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int. J. Psychophysiol., 50, 5 17.
51. Slutsky, D.A. Recanzone, G.H. (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 12, 7 10.
52. Stecker, G.C., Harrington, I.A. Middlebrooks, J.C. (2005) Location coding by opponent neural populations in the auditory cortex. PLoS Biol., 3, 520 528.
53. Stein, B.E. Meredith, M.A. (1993) Merging of Senses. MIT Press, Cambridge, MA.
54. Stein, B.E. Stanford, T.R. (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci., 9, 255 266.
55. Stein, B.E., Huneycutt, W.S. Meredith, M.A. (1988) Neurons and behavior: the same rules of multisensory integration apply. Brain Res., 448, 355 358.
56. Stevenson, R.A., Geoghean, M.L. James, T.W. (2007) Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects. Exp. Brain Res., 179, 85 95.
57. Suga, N. Ma, X. (2003) Multiparametric corticofugal modulation and plasticity in the auditory system. Nat. Rev. Neurosci., 4, 783 794.
58. Wallace, M.T. Stein, B.E. (1994) Cross-modal synthesis in the midbrain depends on input from cortex. J. Neurophysiol., 71, 429 432.
59. van Wassenhove, V., Grant, K.W. Poeppel, D. (2005) Visual speech speeds up the neural processing of auditory speech. Proc. Natl Acad. Sci. USA, 102, 1181 1186.
60. Welch, R.B. (1978) Perceptual Modification: Adapting to Altered Sensory Environments. Academic Press, New York.
61. Wilson, B., Cockburn, J. Halligan, P. (1987) Development of a behavioral test of visuospatial neglect. Arch. Phys. Med. Rehabil., 68, 98 108.
62. Winer, J.A. (2006) Decoding the auditory corticofugal systems. Hear. Res., 212, 1 8.
63. Zatorre, R.J., Bouffard, M., Ahad, P. Belin, P. (2002) Where is "where" in the human auditory cortex? Nat. Neurosci., 5, 905 909.
64. Zwiers, M.P., Van Opstal, A.J. Paige, G.D. (2003) Plasticity in human sound localization induced by compressed spatial vision. Nat. Neurosci., 6, 175 181.