Visual influences on auditory spatial learning

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 364, Issue 1515, 2009, Pages 331-339

  King, Andrew J ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Auditory plasticity; Behavioural training; Multisensory integration; Sound localization; Spatial hearing; Vision

Indexed keywords

AUDITORY CUE; BRAIN; DISEASE TREATMENT; HEARING; HUMAN BEHAVIOR; LEARNING; NEUROLOGY; SENSORY SYSTEM; SENSORY SYSTEM DISORDER; SPATIAL COGNITION; TRAINING; VISION;

EID: 58149215970     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2008.0230     Document Type: Review

References (89)

1. Alais, D. & Burr, D. 2004 The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14, 257-262.
2. Aytekin, M., Moss, C. F. & Simon, J. Z. 2008 A sensorimotor approach to sound localization. Neural. Comput. 20, 603-635.
3. Battaglia, P. W., Jacobs, R. A. & Aslin, R. N. 2003 Bayesian integration of visual and auditory signals for spatial localization. J. Opt. Soc. Am. A Opt. Image. Sci. Vis. 20, 1391-1397.
4. Bergan, J. F., Ro, P., Ro, D. & Knudsen, E. I. 2005 Hunting increases adaptive auditory map plasticity in adult barn owls. J. Neurosci. 25, 9816-9820.
5. Bertelson, P. & Radeau, M. 1981 Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys. 29, 578-584.
6. Bizley, J. K. & King, A. J. 2008 Visual-auditory spatial processing in auditory cortical neurons. Brain Res. 1242, 24-36.
7. Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I. & King, A. J. 2007 Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb. Cortex 17, 2172-2189.
8. Blauert, J. 1997 Spatial hearing: the psychophysics of human sound localization. Cambridge, MA: MIT Press.
9. Brainard, M. S. & Knudsen, E. I. 1998 Sensitive periods for visual calibration of the auditory space map in the barn owl optic tectum. J. Neurosci. 18, 3929-3942.
10. Brosch, M., Selezneva, E. & Scheich, H. 2005 Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. J. Neurosci. 25, 6797-6806.
11. Bulkin, D. A. & Groh, J. M. 2006 Seeing sounds: visual and auditory interactions in the brain. Curr. Opin. Neurobiol. 16, 415-419.
12. Butler, R. A. 1986 The bandwidth effect on monaural and binaural localization. Hearing Res. 21, 67-73.
13. Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D. & David, A. S. 1999 Response amplification in sensory-specific cortices during cross-modal binding. Neuroreport 10, 2619-2623.
14. Campbell, R. A. A., King, A. J., Nodal, F. R., Schnupp, J. W. H., Carlile, S. & Doubell, T. P. 2008 Virtual adult ears reveal the roles of acoustical factors and experience in auditory space map development. J. Neurosci. 28, 11 557-11 570.
15. Clifton, R. K., Gwiazda, J., Bauer, J. A., Clarkson, M. G. & Held, R. M. 1988 Growth in head size during infancy: implications for sound localization. Dev. Psychol. 24, 477-483.
16. DeBello, W. M., Feldman, D. E. & Knudsen, E. I. 2001 Adaptive axonal remodeling in the midbrain auditory space map. J. Neurosci. 21, 3161-3174.
17. Doucet, M. E., Bergeron, F., Lassonde, M., Ferron, P. & Lepore, F. 2006 Cross-modal reorganization and speech perception in cochlear implant users. Brain 129, 3376-3383.
18. Elbert, T., Sterr, A., Rockstroh, B., Pantev, C., Müller, M. M. & Taub, E. 2002 Expansion of the tonotopic area in the auditory cortex of the blind. J. Neurosci. 22, 9941-9944.
19. Ernst, M. O. & Banks, M. S. 2002 Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433.
20. Frissen, I., Vroomen, J., de Gelder, B. & Bertelson, P. 2005 The after effects of ventriloquism: generalization across sound-frequencies. Acta Psychol. (Amst). 118, 93-100.
21. Ghazanfar, A. A., Maier, J. X., Hoffman, K. L. & Logothetis, N. K. 2005 Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 25, 5004-5012.
22. Giard, M. H. & Peronnet, F. 1999 Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11, 473-490.
23. Gori, M., Del Viva, M., Sandini, G. & Burr, D. C. 2008 Young children do not integrate visual and haptic form information. Curr. Biol. 18, 694-698.
24. Goossens, H. H. & Van Opstal, A. J. 1999 Influence of head position on the spatial representation of acoustic targets. J. Neurophysiol. 81, 2720-2736.
25. Gougoux, F., Zatorre, R. J., Lassonde, M., Voss, P. & Lepore, F. 2005 A functional neuroimaging study of sound localization: visual cortex activity predicts performance in early-blind individuals. PLoS Biol. 3, e27.
26. Hartline, P. H., Vimal, R. L. P., King, A. J., Kurylo, D. D. & Northmore, D. P. M. 1995 Effects of eye position on auditory target localization and neural representation of space in the superior colliculus of cat. Exp. Brain Res. 104, 402-408.
27. Heron, J., Whitaker, D. & McGraw, P. V. 2004 Sensory uncertainty governs the extent of audio-visual interaction. Vision Res. 44, 2875-2884.
28. Hofman, P. M., Van Riswick, J. G. & Van Opstal, A. J. 1998 Relearning sound localization with new ears. Nat. Neurosci. 1, 417-421.
29. Jay, M. F. & Sparks, D. L. 1987 Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. J. Neurophysiol. 57, 35-55.
30. Kacelnik, O., Nodal, F. R., Parsons, C. H. & King, A. J. 2006 Training-induced plasticity of auditory localization in adult mammals. PLoS Biol. 4, e71.
31. Kayser, C., Petkov, C. I., Augath, M. & Logothetis, N. K. 2007 Functional imaging reveals visual modulation of specific fields in auditory cortex. J. Neurosci. 27, 1824-1835.
32. Kim, R. S., Seitz, A. R. & Shams, L. 2008 Benefits of stimulus congruency for multisensory facilitation of visual learning. PLoS ONE 3, e1532.
33. King, A. J. 2004 The superior colliculus. Curr. Biol. 14, R335-R338.
34. King, A. J. & Carlile, S. 1993 Changes induced in the representation of auditory space in the superior colliculus by rearing ferrets with binocular eyelid suture. Exp. Brain Res. 94, 444-455.
35. King, A. J. & Parsons, C. H. 1999 Improved auditory spatial acuity in visually deprived ferrets. Eur. J. Neurosci. 11, 3945-3956.
36. King, A. J., Hutchings, M. E., Moore, D. R. & Blakemore, C. 1988 Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus. Nature 332, 73-76.
37. King, A. J., Parsons, C. H. & Moore, D. R. 2000 Plasticity in the neural coding of auditory space in the mammalian brain. Proc. Natl Acad. Sci. USA 97, 11 821-11 828.
38. King, A. J., Schnupp, J. W. H. & Doubell, T. P. 2001 The shape of ears to come: dynamic coding of auditory space. Trends Cogn. Sci. 5, 261-270.
39. Knudsen, E. I. 1998 Capacity for plasticity in the adult owl auditory system expanded by juvenile experience. Science 279, 1531-1533.
40. Knudsen, E. I. & Brainard, M. S. 1991 Visual instruction of the neural map of auditory space in the developing optic tectum. Science 253, 85-87.
41. Knudsen, E. I. & Knudsen, P. F. 1985 Vision guides the adjustment of auditory localization in young barn owls. Science 230, 545-548.
42. Knudsen, E. I. & Knudsen, P. F. 1990 Sensitive and critical periods for visual calibration of sound localization by barn owls. J. Neurosci. 10, 222-232.
43. Knudsen, E. I. & Mogdans, J. 1992 Vision-independent adjustment of unit tuning to sound localization cues in response to monaural occlusion in developing owl optic tectum. J. Neurosci. 12, 3485-3493.
44. Korte, M. & Rauschecker, J. P. 1993 Auditory spatial tuning of cortical neurons is sharpened in cats with early blindness. J. Neurophysiol. 70, 1717-1721.
45. Kushnerenko, E., Teinonen, T., Volein, A. & Csibra, G. 2008 Electrophysiological evidence of illusory audiovisual speech percept in human infants. Proc. Natl Acad. Sci. USA105, 11 442-11 445.
46. Lee, H. J., Truy, E., Mamou, G., Sappey-Marinier, D. & Giraud, A. L. 2007 Visual speech circuits in profound acquired deafness: a possible role for latent multimodal connectivity. Brain 130, 2929-2941.
47. Lewald, J. 2002 Rapid adaptation to auditory-visual spatial disparity. Learn. Mem. 9, 268-278.
48. Lewald, J. 2007 More accurate sound localization induced by short-term light deprivation. Neuropsychologia 45, 1215-1222.
49. Litovsky, R. Y., Johnstone, P. M. & Godar, S. P. 2006 Benefits of bilateral cochlear implants and/or hearing aids in children. Int. J. Audiol. 45, S78-S91.
50. Long, C. J., Carlyon, R. P., Litovsky, R. Y. & Downs, D. H. 2006 Binaural unmasking with bilateral cochlear implants. J. Assoc. Res. Otolaryngol. 7, 352-360.
51. McGurk, H. & MacDonald, J. 1976 Hearing lips and seeing voices. Nature 264, 746-748.
52. Middlebrooks, J. C. 1999 Virtual localization improved by scaling nonindividualized external-ear transfer functions in frequency. J. Acoust. Soc. Am. 106, 1493-1510.
53. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E. & Foxe, J. J. 2002 Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14, 115-128.
54. Moore, D. R. & Irvine, D. R. F. 1979 A developmental study of the sound pressure transformation by the head of the cat. Acta Otolaryngol. 87, 434-440.
55. Nardini, M., Jones, P., Bedford, R. & Braddick, O. 2008 Development of cue integration in human navigation. Curr. Biol. 18, 689-693.
56. Neil, P. A., Chee-Ruiter, C., Scheier, C., Lewkowicz, D. J. & Shimojo, S. 2006 Development of multisensory spatial integration and perception in humans. Dev. Sci. 9, 454-464.
57. Populin, L. C., Tollin, D. J. & Yin, T. C. T. 2004 Effect of eye position on saccades and neuronal responses to acoustic stimuli in the superior colliculus of the behaving cat. J. Neurophysiol. 92, 2151-2167.
58. Putzar, L., Goerendt, I., Lange, K., Rösler, F. & Röder, B. 2007 Early visual deprivation impairs multisensory interactions in humans. Nat. Neurosci. 10, 1243-1245.
59. Radeau, M. & Bertelson, P. 1974 The after-effects of ventriloquism. Q. J. Exp. Psychol. 26, 63-71.
60. Razavi, B., O'Neill, W. E. & Paige, G. D. 2007 Auditory spatial perception dynamically realigns with changing eye position. J. Neurosci. 27, 10 249-10 258.
61. Recanzone, G. H. 1998 Rapidly induced auditory plasticity: the ventriloquism aftereffect. Proc. Natl Acad. Sci. USA 95, 869-875.
62. Recanzone, G. H. & Sutter, M. L. 2008 The biological basis of audition. Annu. Rev. Psychol. 59, 119-142.
63. Röder, B., Teder-Sälejärvi, W., Sterr, A., Rösler, F., Hillyard, S. A. & Neville, H. J. 1999 Improved auditory spatial tuning in blind humans. Nature 400, 162-166.
64. Rouger, J., Lagleyre, S., Fraysse, B., Deneve, S., Deguine, O. & Barone, P. 2007 Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc. Natl Acad. Sci. USA 104, 7295-7300.
65. Schnupp, J. W. H., Booth, J. & King, A. J. 2003 Modeling individual differences in ferret external ear transfer functions. J. Acoust. Soc. Am. 113, 2021-2030.
66. Schorr, E. A., Fox, N. A., Van Wassenhove, V. & Knudsen, E. I. 2005 Auditory-visual fusion in speech perception in children with cochlear implants. Proc. Natl Acad. Sci. USA 102, 18 748-18 750.
67. Schroeder, C. E. & Foxe, J. J. 2002 The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14, 187-198.
68. Schroeder, C. E. & Foxe, J. 2005 Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol. 15, 454-458.
69. Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S. & Puce, A. 2008 Neuronal oscillations and visual amplification of speech. Trends Cogn. Sci. 12, 106-113.
70. Shelton, B. R. & Searle, C. L. 1980 The influence of vision on the absolute identification of sound-source position. Percept. Psychophys. 28, 589-596.
71. Slattery, W. H. & Middlebrooks, J. C. 1994 Monaural sound localization: acute versus chronic unilateral impairment. Hearing Res. 75, 38-46.
72. Stein, B. E. & Stanford, T. R. 2008 Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 9, 255-266.
73. Stein, B. E., Meredith, M. A., Huneycutt, W. S. & McDade, L. 1989 Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J. Cogn. Neurosci. 1, 12-24.
74. Su, T. I. & Recanzone, G. H. 2001 Differential effect of near-threshold stimulus intensities on sound localization performance in azimuth and elevation in normal human subjects. J. Assoc. Res. Otolaryngol. 2, 246-256.
75. Sumby, W. H. & Pollack, I. 1954 Visual contributions to speech intelligibility in noise. J. Acoust. Soc. Am. 26, 212-215.
76. Van Wanrooij, M. M. & Van Opstal, A. J. 2004 Contribution of head shadow and pinna cues to chronic monaural sound localization. J. Neurosci. 24, 4163-4171.
77. Van Wanrooij, M. M. & Van Opstal, A. J. 2005 Relearning sound localization with a new ear. J. Neurosci. 25, 5413-5424.
78. Vliegen, J., Van Grootel, T. J. & Van Opstal, A. J. 2004 Dynamic sound localization during rapid eye-head gaze shifts. J. Neurosci. 24, 9291-9302.
79. Wallace, M. T. & Stein, B. E. 2007 Early experience determines how the senses will interact. J. Neurophysiol. 97, 921-926.
80. Wallace, M. T., Ramachandran, R. & Stein, B. E. 2004a A revised view of sensory cortical parcellation. Proc. Natl Acad. Sci. USA 101, 2167-2172.
81. Wallace, M. T., Perrault Jr, T. J., Hairston, W. D. & Stein, B. E. 2004b Visual experience is necessary for the development of multisensory integration. J. Neurosci. 24, 9580-9584.
82. Weeks, R., Horwitz, B., Aziz-Sultan, A., Tian, B., Wessinger, C. M., Cohen, L. G., Hallett, M. & Rauschecker, J. P. 2000 A positron emission tomographic study of auditory localization in the congenitally blind. J. Neurosci. 20, 2664-2672.
83. Wenzel, E. M., Arruda, M., Kistler, D. J. & Wightman, F. L. 1993 Localization using nonindividualized head-related transfer functions. J. Acoust. Soc. Am. 94, 111-123.
84. Wightman, F. L. & Kistler, D. J. 1997 Monaural sound localization revisited. J. Acoust. Soc. Am. 101, 1050-1063.
85. Withington-Wray, D. J., Binns, K. E. & Keating, M. J. 1990 The maturation of the superior collicular map of auditory space in the guinea pig is disrupted by developmental visual deprivation. Eur. J. Neurosci. 2, 682-692.
86. Woods, T. M. & Recanzone, G. H. 2004 Visually induced plasticity of auditory spatial perception in macaques. Curr. Biol. 14, 1559-1564.
87. Zwiers, M. P., Van Opstal, A. J. & Cruysberg, J. R. 2001 A spatial hearing deficit in early-blind humans. J. Neurosci. 21, 1-5.
88. Zwiers, M. P., Van Opstal, A. J. & Paige, G. D. 2003 Plasticity in human sound localization induced by compressed spatial vision. Nat. Neurosci. 6, 175-181.
89. Zwiers, M. P., Versnel, H. & Van Opstal, A. J. 2004 Involvement of monkey inferior colliculus in spatial hearing. J. Neurosci. 24, 4145-4156.