Development of multisensory integration: Transforming sensory input into motor output

Mental Retardation and Developmental Disabilities Research Reviews

Volumn 5, Issue 1, 1999, Pages 72-85

  Stein, Barry E ^a   Wallace, Mark T ^a   Stanford, Terrence R ^a  

^a WAKE FOREST SCHOOL OF MEDICINE   (United States)

Author keywords

Audition; Cross modal; Development; Multisensory; Somesthesis; Superior colliculus; Vision

Indexed keywords

ATTENTION; BRAIN FUNCTION; MESENCEPHALON; MOTOR ACTIVITY; NEOCORTEX; NERVOUS SYSTEM DEVELOPMENT; ORIENTATION; PRIORITY JOURNAL; RECEPTIVE FIELD; REVIEW; SENSORY DEPRIVATION; SENSORY NERVE CELL; SENSORY STIMULATION;

EID: 0032999771     PISSN: 10804013     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1098-2779(1999)5:1<72::AID-MRDD8>3.0.CO;2-U     Document Type: Review

References (81)

1. Barth DS, Goldberg N, Brett B, Di S. 1995. The spatiotemporal organization of auditory, visual and auditory-visual evoked potentials in rat cortex. Brain Res 678:177-190.
2. Benedetti F. 1991. The postnatal emergence of a functional soniatosensory representation in the superior colliculus of the mouse. Dev Brain Res 60:51-57.
3. Benedetti F. 1995. Orienting behaviour and superior colliculus sensory representations in mice with the vibrissae bent into the contralateral hemispace. Eur J Neurosci 7:1512-1519.
4. Bower TGR. 1977. A primer of infant development. San Francisco: W.H. Freeman.
5. Brainard MA, Knudsen EI. 1995. Dynamics of visually guided auditory plasticity in the optic tectum of the barn owl. J Neurophysiol 73:595-614.
6. Butterworth G. 1981. The origins of auditory-visual perception and visual proprioception in human development. In: Walk RD, Pick LH Jr, editors. Intersensory perception and sensory integration. New York: Plenum. p 37-70.
7. Casagrande VA, Harting JK, Hall WC, Diamond IT. 1972. Superior colliculus of the tree shrew: a structural and functional subdivision into superficial and deep layers. Science 177:444-447.
8. Clarey JC, Irvine DRF. 1990. The anterior ectosylvian sulcal auditory field in the cat: I. An electrophysiological study of its relationship to surrounding auditory cortical fields. J Comp Neurol 301:289-303.
9. Clemo HR, Stein BE. 1982. Somatosensory cortex: a "new" somatotopic representation. Brain Res 235:162-168.
10. Edwards SB, Ginsburgh CL, Henkel CK, Stein BE. 1979. Sources of subcortical projections to the superior colliculus in the cat. J Comp Neurol 184:309-330.
11. Fox MW. 1970. Reflex development and behavioral organization. In: Himwich WA, editor. Developmental neurobiology. Springfield, IL: Thomas. p 553-580.
12. Frens MA, Van Opstal AJ, Van der Willigen RF. 1995. Spatial and temporal factors determine audio-visual interactions in saccadic eye movements. Percept Psychophys 57:802-816.
13. Garraghty PE, Salinger WL, MacAvoy MG, Schroeder CE, Guido W. 1982. The shift in X/Y ratio after chronic monocular paralysis: a binocularly mediated, barbiturate-sensitive effect in the adult lateral geniculate nucleus. Exp Brain Res 47:301-308.
14. Goldring JE, Dorris MC, Corneil BD, Ballantyne PA, Munoz DP. 1996. Combined eye-head gaze shifts to visual and auditory targets in humans. Exp Brain Res 111:68-78.
15. Groh JM, Sparks DL. 1996. Saccades to somatosensory targets. III. Eye-position-dependent somatosensory activity in primate superior colliculus. J Neurophysiol 75:439-453.
16. Hartline PH, Vimal RL, King AJ, Kurylo DD, Northmore DP. 1995. Effects of eye position on auditory localization and neural representation of space in superior colliculus of cats. Exp Brain Res 104:402-408.
17. Hein AF, Vital-Durand F, Salinger W, Diamond R. 1979. Eye movements initiate visual-motor development in the cat. Science 204:1321-1322.
18. Hughes HC, Reuter-Lorenz PA, Nozawa G, Fendrich R. 1994. Visual-auditory interactions in sensorimotor processing: saccades versus manual responses. J Exp Psychol Hum Percept Perf 20:131-153.
19. James W. 1890. Principles of psychology, vol 1. New York. Holtz. [Reprinted 1983. Cambridge, MA: Harvard University Press.]
20. Jay MF, Sparks DL. 1984. Auditory receptive fields in primate superior colliculus shift with changes in eye position. Nature 309:345-347.
21. Jay MF, Sparks DL. 1987a. Sensorimotor integration in the primate superior colliculus. I. Motor convergence. J Neurophysiol 57: 22-34.
22. Jay MF, Sparks DL. 1987b. Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. J Neurophysiol 57:35-55.
23. Jiang H, Lepore F, Ptito M, Guillemot J-P. 1994. Sensory interactions in the anterior ectosylvian cortex of cats. Exp Brain Res 101:385-396.
24. Kadunce DC, Vaughan JW, Wallace MT, Benedek G, Stein BE. 1997. Mechanisms of withinand cross-modality suppression in the superior colliculus. J Neurophysiol 78:2834-2847.
25. King AJ, Carlile S. 1993. Changes induced in the representation of auditory space in the superior colliculus be rearing ferrets with binocular lid suture. Exp Brain Res 94:444-455.
26. King AJ, Hutchings ME, Moore DR, Blakemore C. 1988. Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus. Nature 332: 73-76.
27. King AJ, Schnupp JW, Carlile S, Smith AL, Thompson ID. 1996. The development of topographically-aligned maps of visual and auditory space in the superior colliculus. Prog Brain Res 112:335-350.
28. Knudsen EI, Brainard MS. 1991. Visual instruction of the neural map of auditory space in the developing optic tectum. Science 253:85-87
29. Larson MA, Stein BE. 1984. The use of tactile and olfactory cues in neonatal orientation and localization of the nipple. Dev Psychobiol 17:423-436.
30. Lee C, Chung S, Kim J, Park J. 1991. Auditory facilitation of visually guided saccades. Soc Neurosci Abst 17:862.
31. Leigh RJ, Zee DS. 1980. Eye movements of the blind. Invest Ophthalmol Vis Sci 19:328-331.
32. Maurer D, Maurer C. 1988. The world of the newborn. New York: Basic Books.
33. McGurk H, MacDonald J. 1976. Hearing lips and seeing voices. Nature 264:746-748.
34. McIlwain JT. 1991. Distributed spatial coding in the superior colliculus: a review. Visual Neurosci 6:3-13.
35. Meredith MA, Stein BE. 1983. Interactions among converging sensory inputs in the superior colliculus. Science 221:389-391.
36. Meredith MA, Stein BE. 1986. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640-662.
37. Meredith MA, Stein BE. 1996 Spatial determinants of multisensory integration in cat superior colliculus neurons. J Neurophysiol 75:1843-1857.
38. Meredith MA, Nemitz JW, Stein BE. 1987. Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7:3215-3229.
39. Morrongiello BA. 1994. The effects of co-location of auditory-visual interactions and cross-modal perception in infants. In: Lewkowitz DJ, Lickliter R, editors. The development of intersensory perception: comparative perspectives. Hillsdale, NJ: Erlbaum. p 235-263.
40. Mucke L, Norita M, Benedek G, Creutzfeldt O. 1982. Physiologic and anatomic investigation of a visual cortical area situated in the ventral bank of the anterior ectosylvian sulcus of the cat. Exp Brain Res 46:1-11.
41. Norton TT. 1974. Receptive-field properties of superior colliculus cells and development of visual behavior in kittens. J Neurophysiol 37:674-690.
42. Olson CR, Graybiel AM. 1987. Ectosylvian visual area of the cat: location, retinotopic organization, and connections. J Comp Neurol 261:277-294.
43. Paulesu E, Harrison J, Baron-Cohen S, Watson JDG, Goldstein L, Heather J, Frackowiak RSJ, Frith CD. 1995. The physiology of coloured hearing: a PET activation study of colour-word synaesthesia. Brain 118:661-676.
44. Peck CK, Baro JA, Warder SM. 1995. Effects of eye position on saccadic eye movements and on the neuronal responses to auditory and visual stimuli in cat superior colliculus. Exp Brain Res 103:227-242.
45. Perrott DR, Saberi K, Brown K, Strybel TA. 1990. Auditory psychomotor coordination and visual search performance. Percept Psychophys 48:214-226.
46. Ramachandran R, Wallace MK, Clemo HR, Stein BE. 1993. Multisensory convergence and integration in rat cortex. Soc Neurosci Abst 19:1447.
47. Robinson DA. 1972. Eye movements evoked by collicular stimulation in the alert monkey. Vision Res 12:1795-1808.
48. Roucoux A, Crommelinck M. 1976. Eye movements evoked by superior colliculus stimulation in the alert cat. Brain Res 106:349-363.
49. Sams M, Aulanko T, Hamalainen H, Hari R, Lounasmaa OV, Lu DT, Simola J. 1991. Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci Lett 127:141-145.
50. Schaefer KP. 1970. Unit analysis and electrical stimulation in the optic tectum of rabbits and cats. Brain Behav Evol 3:222-240.
51. Schneider GE. 1969. Two visual systems: brain mechanisms for localization and discrimination are dissociated by tectal and cortical lesions. Science 163:895-902.
52. Sparks DL. 1986. Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. Physiol Rev 66:116-177.
53. Sparks DL, Nelson JS. 1987. Sensory and motor maps in the mammalian superior colliculus. Trends Neurosci 10:312-317.
54. Sprague JM, Meikle TH Jr. 1965. The role of the superior colliculus in visually guided behavior. Exp Neurol 11:115-146.
55. Stein BE. 1984. Development of the superior colliculus. Ann Rev Neurosci 7:95-125.
56. Stein BE, Clamann HP. 1981. Control of pinna movements and sensorimotor register in cat superior colliculus. Brain Behav Evol 19:180-192.
57. Stein BE, Gallagher HL. 1981. Maturation of cortical control over superior colliculus cells in cat. Brain Res 223:429-435.
58. Stein BE, Meredith MA. 1991. Functional organization of the superior colliculus. In: Leventhal AG, editor. The neural bases of visual function. Hampshire, UK: Macmillan. p 85-110.
59. Stein BE, Meredith MA. 1993. The merging of the senses. Cambridge, MA: MIT Press.
60. Stein BE, Labos E, Kruger L. 1973a. Sequence of changes in properties of neurons of superior colliculus of the kitten during maturation. J Neurophysiol 36:667-679.
61. Stein BE, Labos E, Kruger L. 1973b. Determinants of response latency in neurons of superior colliculus in kittens. J Neurophysiol 36:680-689.
62. Stein BE, Goldberg SJ, Clamann HP. 1976. The control of eye movements by the superior colliculus in the alert cat. Brain Res 118:469-474.
63. Stein BE, Clamann HP, Goldberg SJ. 1980. Superior colliculus: control of eye movements in neonatal kittens. Science 210:78-80.
64. Stein BE, Spencer RF, Edwards SB. 1983. Corticotectal and corticothalamic efferent projections of SIV somatosensory cortex in cat. J Neurophysiol 50:896-909.
65. Stein BE, Meredith MA, Huneycutt WS, McDade L. 1989. Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J Cogn Neurosci 1:12-24.
66. Turkewitz G, Kenny PA. 1985. The role of developmental limitations of sensory input on sensory/perceptual organization. J Dev Behav Pediat 6:302-306.
67. Wallace MT, Stein BE. 1994. Cross-modal synthesis in the midbrain depends on input from association cortex. J Neurophysiol 71:429-432.
68. Wallace MT, Stein BE. 1996. Development of auditory responsiveness, topography, and functional convergence with visual inputs in cat superior colliculus (SC). Soc Neurosci Abst 22:636.
69. Wallace MT, Stein BE. 1997a. Development of multisensory integration in cat superior colliculus. J Neurosci 17:2429-2444.
70. Wallace MT, Stein BE. 1997b. Development of somatosensory responses, topography and interactions with other sensory modalities in cat superior colliculus (SC). Soc Neurosci Abst 23:1541.
71. Wallace MT, Meredith MA, Stein BE. 1993a. Converging influences from visual, auditory and somatosensory cortices onto output neurons of the superior colliculus. J Neurophysiol 69:1797-1809.
72. Wallace MT, Meredith MA, Stein BE. 1993b. Development of multisensory integration in cat superior colliculus. Soc Neurosci Abst 19:240.
73. Wallace MT, Wilkinson LK, Stein BE. 1994. Sensory representations and the integration of multiple sensory cues in monkey superior colliculus. Soc Neurosci Abst 20:1186.
74. Wallace MT, McHaffie JG, Stein BE. 1995. Sensory response properties in the superior colliculus (SC) of the newborn rhesus monkey. Soc Neurosci Abst 21:655.
75. Wallace MT, Wilkinson LK, Stein BE. 1996. Representation and integration of multiple sensory inputs in primate superior colliculus. J Neurophysiol 76:1246-1266.
76. Wilkinson LK, Meredith MA, Stein BE. 1996. The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior. Exp Brain Res 112:1-10.
77. Withington-Wray DJ, Binns KE, Keating MJ. 1990a. The maturation of the superior collicular map of auditory space in the guinea pig is disrupted by developmental visual deprivation. Eur J Neurosci 2:682-692.
78. Withington-Wray DJ, Binns KE, Dhanjal SS, Brickley SG, Keating MJ. 1990b. The maturation of the collicular map of auditory space in the guinea pig is disrupted by developmental auditory deprivation. Eur J Neurosci 2:693-703.
79. Wurtz RH, Goldberg ME. 1972a. Activity of superior colliculus in behaving monkey. III. Cells discharging before eye movements. J Neurophysiol 35:575-586.
80. Wurtz RH, Goldberg ME. 1972b. Activity of superior colliculus in behaving monkey. IV. Effects of lesions on eye movements. J Neurophysiol 35:587-596.
81. Zahn JR, Abel LA, Dell'Osso LF. 1978. Audio-ocular response characteristics. Sensory Processes 2:32-37.