Creating a unified representation of visual and auditory space in the brain

Annual Review of Neuroscience

Volumn 18, Issue , 1995, Pages 19-43

  Knudsen, E I ^a   Brainard, M S ^a  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

auditory plasticity; experience dependent plasticity; sound localization; space perception; superior colliculus

Indexed keywords

ANIMAL EXPERIMENT; AUDITORY SYSTEM; BRAIN MAPPING; HUMAN; HUMAN EXPERIMENT; NONHUMAN; NORMAL HUMAN; PRIORITY JOURNAL; REVIEW; SENSORY SYSTEM ELECTROPHYSIOLOGY; VISUAL SYSTEM;

EID: 0028906015     PISSN: 0147006X     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.ne.18.030195.000315     Document Type: Review

References (86)

1. Auerbach C, Sperling P. 1974. A common auditory-visual space: evidence for its reality. Percept. Psychophys. 16:129-35
2. Andersen RA, Snyder LH, Li CS, Stricanne B. 1993. Coordinate transformations in the representation of spatial information. Curr. Opin. Neurobiol. 3:171-76
3. Berson DM. 1988. Retinal and cortical inputs to cat superior colliculus: composition, convergence and laminar specificity. Prog. Brain Res. 75:17-26
4. Blauert J. 1983. Spatial Hearing: The Psychophysics of Human Sound Localization. Cambridge, MA: MIT Press
5. Brainard MS, Knudsen EI. 1993. Experience-dependent plasticity in the inferior colliculus: a site for visual calibration of the neural representation of auditory space in the barn owl. J. Neurosci. 13:4589-608
6. Brainard MS, Knudsen EI, Esterly SD. 1992. Neural derivation of sound source location: resolution of spatial ambiguities in binaural cues. J. Acoust. Soc. Am. 91:1015-27
7. Brown TH, Zador AM, Mainen ZF, Claiborne BJ. 1991. Hebbian modifications in hippocampal neurons. In LTP: A Debate of Current Issues, ed. M Baudry, J Davis, pp. 357-89. Cambridge, MA: MIT Press
8. Carlile S. 1990. The auditory periphery of the ferret. I: directional response properties and the pattern of interaural level differences. J. Acoust. Soc. Am. 88:2180-95
9. Carlile S, Pettigrew AG. 1987. Directional properties of the auditory periphery in the guinea pig. Hear. Res. 31:111-22
10. Carr CE, Konishi M. 1990. A circuit for detection of interaural time differences in the brainstem of the barn owl. J. Neurosci. 10:3227-46
11. Colby CL. 1991. The neuroanatomy and neurophysiology of attention. J. Child Neurol. 6:S90-S118
12. Cynader M, Berman N. 1972. Receptive-field organization of monkey superior colliculus. J. Neurophysiol. 35:187-201
13. Desimone R, Wessinger M, Thomas L, Schneider W. 1990. Attentional control of visual perception: cortical and subcortical mechanisms. Cold Spring Harbor Symp. Quant. Biol., Vol. LV, pp. 963-71. Cold Spring Harbor, NY: Cold Spring Harbor Lab. Press
14. Devor M, Wall PD. 1978. Reorganisation of spinal cord sensory map after peripheral nerve injury. Nature 276:75-76
15. Fawcett JW, O'Leary DDM. 1985. The role of electrical activity in the formation of topographic maps in the nervous system. Trends Neurosci. 8:201-6
16. Fishman MC, Michael CR. 1973. Integration of auditory information in the cat's visual cortex. Vision Res. 13:1415-19
17. Gilbert CD, Wiesel TN. 1992. Receptive field dynamics in adult primary visual cortex. Nature 356:150-52
18. Guitton D. 1992. Control of eye-head coordination during orienting gaze shifts. Trends Neurosci. 15(5):174-79
19. Guitton D, Munoz DP, Galiana HL. 1990. Gaze control in the cat: studies and modeling of the coupling between orienting eye and head movements in different behavioral tasks. J. Neurophysiol. 64:509-31
20. Harris LR, Blakemore C, Donaghy M. 1980. Integration of visual and auditory space in the mammalian superior colliculus. Nature 288:56-59
21. Hikosaka K, Iwai E, Saito H, Tanaka K. 1988. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J. Neurophysiol. 60:1615-37
22. Howard IP. 1982. Human Visual Orientation. New York: Wiley
23. Jack CE, Thurlow WR. 1973. Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. Percept. Mot. Skills 37:967-79
24. Jackson CV. 1953. Visual factors in auditory localization. Q. J. Exp. Psychol. 5:52-65
25. Jay MF, Sparks DL. 1987. Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. J. Neurophysiol. 57:35-55
26. Jenkins WM, Merzenich MM, Ochs MT, Allard T, Guic-Robles E. 1990. Functional reorganization of primary somatosensory cortex in adult owl monkeys after behaviorally controlled tactile stimulation. J. Neurophysiol. 63:82-104
27. Kaas JH. 1991. Plasticity of sensory and motor maps in adult mammals. Annu. Rev. Neurosci. 14:137-67
28. Kelso SR, Brown TH. 1986. Differential conditioning of associative synaptic enhancement in hippocampal brain slices. Science 232:85-87
29. King AJ, Carlile S. 1993. Changes induced in the representation of auditory space in the superior colliculus by rearing ferrets with binocular eyelid suture. Exp. Brain Res. 94: 444-55
30. King AJ, Hutchings ME. 1987. Spatial response properties of acoustically responsive neurons in the superior colliculus of the ferret: a map of auditory space. J. Neurophysiol. 57:596-624
31. King AJ, Hutchings ME, Moore DR, Blakemore C. 1988. Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus. Nature 332:73-76
32. King AJ, Palmer AR. 1983. Cells responsive to free-field auditory stimuli in guinea-pig superior colliculus: distribution and response properties. J. Physiol. 342:361-81
33. King AJ, Palmer AR. 1985. Integration of visual and auditory information in bimodal neurons in the guinea-pig superior colliculus. Exp. Brain Res. 60:492-500
34. Knudsen EI. 1982. Auditory and visual maps of space in the optic tectum of the owl. J. Neurosci. 2:1177-94
35. Knudsen EI. 1983. Early auditory experience aligns the auditory map of space in the optic tectum of the barn owl. Science 222: 939-42
36. Knudsen EI. 1984. Synthesis of a neural map of auditory space in the owl. In Dynamic Aspects of Neocortical Function, ed. GM Edelman, WM Cowan, WE Gall, pp. 375-96. New York: Wiley
37. Knudsen EI. 1985. Experience alters the spatial tuning of auditory units in the optic tectum during a sensitive period in the barn owl. J. Neurosci. 5:3094-109
38. Knudsen EI. 1989. Fused binocular vision is required for development of proper eye alignment in barn owls. Vis. Neurosci. 2:35-40
39. Knudsen EI. 1994. Supervised learning in the brain. J. Neurosci. 14:3985-97
40. Knudsen EI, Brainard MS. 1991. Visual instruction of the neural map of auditory space in the developing optic tectum. Science 253: 85-87
41. Knudsen EI, du Lac S, Esterly SD. 1987. Computational maps in the brain. Annu. Rev. Neurosci. 10:41-65
42. Knudsen EI, Esterly SD, du Lac S. 1991. Stretched and upside-down maps of auditory space in the optic tectum of blind-reared owls; acoustic basis and behavioral correlates. J. Neurosci. 11:1727-47
43. Knudsen EI, Esterly SD, Olsen JF. 1994. Adaptive plasticity of the auditory space map in the optic tectum of adult and baby barn owls in response to external ear modification. J. Neurophysiol. 71:79-94
44. Knudsen EI, Knudsen PF. 1989. Vision calibrates sound localization in developing barn owls. J. Neurosci. 9:3306-13
45. Knudsen EI, Knudsen PF. 1990. Sensitive and critical periods for visual calibration of sound localization by barn owls. J. Neurosci. 63: 131-49
46. Knudsen EI, Mogdans J. 1992. Vision-independent adjustment of unit tuning to sound localization cues in response to monaural occlusion in developing owl optic tectum. J. Neurosci. 12:3485-93
47. Lane RH, Allman JM, Kaas JH, Miezin FM. 1973. The visuotopic organization of the superior colliculus of the owl monkey (Aotus trivirgatus) and the bush baby (Galago senegalensis). Brain Res. 60:335-49
48. Manley GA, Koeppl C, Konishi M. 1988. A neural map of interaural intensity difference in the brainstem of the barn owl Tyto alba. J. Neurosci. 8:2665-76
49. Margoliash D. 1986. Preference for autogenous song by auditory neurons in a song system nucleus of the white-crowned sparrow. J. Neurosci. 6(6):1643-61
50. Meister M, Wong ROL, Baylor DA, Shatz CJ. 1991. Synchronous bursts of action potentials in ganglion cells of the developing mammalian retina. Science 252:939-43
51. Meredith MA, Nemitz JW, Stein BE. 1987. Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J. Neurosci. 7:3215-29
52. Meredith MA, Stein BE. 1983. Interactions among converging sensory inputs in the superior colliculus. Science 221:389-91
53. Meredith MA, Stein BE. 1986a. Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res. 365:350-54
54. Meredith MA, Stein BE. 1986b. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J. Neurophysiol. 56: 640-62
55. Middlebrooks JC, Green DM. 1991. Sound localization by human listeners. Annu. Rev. Psychol. 42:135-59
56. Middlebrooks JC, Knudsen EI. 1984. A neural code for auditory space in the cat's superior colliculus. J. Neurosci. 4:2621-34
57. Miller KD. 1989. Correlation-based models of neural development. In Neuroscience and Connectionist Theory, ed. MA Gluck, DE Rumelhart, pp. 267-352. Hillsdale, NJ: Lawrence Erlbaum Assoc.
58. Miyashita Y. 1988. Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature 335:817-20
59. Mogdans J, Knudsen EI. 1992. Adaptive adjustment of unit tuning to sound localization cues in response to monaural occlusion in developing owl optic tectum. J. Neurosci. 12: 3473-84
60. Morrell F. 1972. Visual system's view of acoustic space. Nature 238:44-46
61. Olsen JF, Knudsen EI, Esterly SD. 1989. Neural maps of interaural time and intensity differences in the optic tectum of the barn owl. J. Neurosci. 9:2591-605
62. Peck CK, Baro JA, Warder SM. 1993. Sensory integration in the deep layers of superior colliculus. Prog. Brain Res. 95:91-102
63. Perrott DR, Saberi K, Brown K, Strybel TZ. 1990. Auditory psychomotor coordination and visual search behavior. Percept. Psychophys. 48:214-26
64. Perrott DR, Sadralodabai T, Saberi K, Strybel T. 1991. Aurally aided visual search in the central visual field: effects of visual load and visual enhancement of the target. Hum. Factors 33:389-400
65. Pons TP, Garraghty PE, Ommaya AK, Kaas JH, Taub E, Mishkin M. 1991. Massive cortical reorganization after sensory deafferentation in adult macaques. Science 252:1857-60
66. Recanzone GH, Schreiner CE, Merzenich MM. 1993. Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys. J. Neurosci. 13(1):87-103
67. Sanes JR. 1993. Topographic maps and molecular gradients. Curr. Opin. Neurobiol. 3:67-74
68. Sparks DL. 1990. Signal transformations required for the generation of saccadic eye movements. Annu. Rev. Neurosci. 13:309-36
69. Stein BE, Huneycutt WS, Meredith MA. 1988. Neurons and behavior: the same rules of multisensory integration apply. Brain Res. 448: 355-58
70. Stein BE, Meredith MA. 1990. Multisensory integration: neural and behavioral solutions for dealing with stimuli from different sensory modalities. Ann. NY Acad. Sci. 608:51-70
71. Stein BE, Meredith MA. 1993. The Merging of the Senses. Cambridge, MA: MIT Press
72. Stein BE, Meredith MA, Huneycutt WS, McDade L. 1989. Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J. Cogn. Neurosci. 1:1-12
73. Stein BE, Meredith MA, Wallace MT. 1993. The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog. Brain Res. 95:79-90
74. Sterling P, Wickelgren BG. 1969. Visual receptive fields in the superior colliculus of the cat. J. Neurophysiol. 32:1-15
75. Tamura R, Ono T, Fukuda M, Nakamura K. 1990. Recognition of egocentric and allocentric visual and auditory space by neurons in the hippocampus of monkeys. Neurosci. Lett. 109:293-98
76. Tamura R, Ono T, Fukuda M, Nakamura K. 1992. Spatial responsiveness of monkey hippocampal neurons to various visual and auditory stimuli. Hippocampus 2:307-22
77. Thurlow WR, Rosenthal, TM. 1976. Further study of existence regions for the "ventriloquism effect." J. Am. Audiol. Soc. 1:280-86
78. Udin SB, Fawcett JW. 1988. Formation of topographic maps. Annu. Rev. Neurosci. 11: 289-327
79. Van Essen DC, Anderson CH, Felleman DJ. 1992. Information processing in the primate visual system: an integrated systems perspective. Science 255:419-23
80. Wagner H, Takahashi T, Konishi M. 1987. Representation of interaural time difference in the central nucleus of the barn owl's inferior colliculus. J. Neurosci. 7:3105-16
81. Wallace MT, Meredith MA, Stein BE. 1992. The integration of multiple sensory inputs in cat cortex. Exp. Brain Res. 91:484-88
82. Warren DH, Welch RB, McCarthy TJ. 1981. The role of visual-auditory "compellingness" in the ventriloquism effect: implications for transitivity among the spatial senses. Percept. Psychophys. 30:557-64
83. Watanabe J, Iwai E. 1991. Neuronal activity in visual, auditory and polysensory areas in the monkey temporal cortex during visual fixation task. Brain Res. Bull. 26:583-92
84. Wenstrup JJ, Ross LS, Pollak GD. 1986. Binaural response organization within a frequency-band representation of the inferior colliculus: implications for sound localization. J. Neurosci. 6:962-73
85. Wise LZ, Irvine DRF. 1985. Topographic organization of interaural intensity difference sensitivity in deep layers of cat superior colliculus: implications for auditory spatial representation. J. Neurophysiol. 54:185-211
86. Withington DJ. 1992. The effect of binocular lid suture on auditory responses in the guinea-pig superior colliculus. Neurosci. Lett. 136:153-56