Organization and plasticity in multisensory integration. Early and late experience affects its governing principles

Progress in Brain Research

Volumn 191, Issue , 2011, Pages 145-163

  Stein, Barry E ^a   Rowland, Benjamin A ^a  

^a WAKE FOREST SCHOOL OF MEDICINE   (United States)

Author keywords

Auditory; Cross modal; Development; Somatosensory; Visual

Indexed keywords

BOOK; BRAIN CORTEX; HUMAN; MESENCEPHALON; MULTISENSORY INTEGRATION; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL PLASTICITY; NONHUMAN; PRIORITY JOURNAL; SEMANTICS; SENSORY SYSTEM; SUPERIOR COLLICULUS;

EID: 79960044501     PISSN: 00796123     EISSN: 18757855     Source Type: Book Series    
DOI: 10.1016/B978-0-444-53752-2.00007-2     Document Type: Chapter

References (68)

1. Alvarado J.C., Rowland B.A., Stanford T.R., Stein B.E. A neural network model of multisensory integration also accounts for unisensory integration in superior colliculus. Brain Research 2008, 1242:13-23.
2. Alvarado J.C., Stanford T.R., Rowland B.A., Vaughan J.W., Stein B.E. Multisensory integration in the superior colliculus requires synergy among corticocollicular inputs. The Journal of Neuroscience 2009, 29:6580-6592.
3. Alvarado J.C., Stanford T.R., Vaughan J.W., Stein B.E. Cortex mediates multisensory but not unisensory integration in superior colliculus. The Journal of Neuroscience 2007, 27:12775-12786.
4. Angelaki D., Gu Y., Deangelis G. Visual and vestibular cue integration for heading perception in extrastriate visual cortex. Journal of Physiology 2011, 589:825-833.
5. Behan M., Appell P.P. Intrinsic circuitry in the cat superior colliculus: Projections from the superficial layers. The Journal of Comparative Neurology 1992, 315:230-243.
6. Bell A.H., Meredith M.A., Van Opstal A.J., Munoz D.P. Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements. Journal of Neurophysiology 2005, 93:3659-3673.
7. Burnett L.R., Stein B.E., Chaponis D., Wallace M.T. Superior colliculus lesions preferentially disrupt multisensory orientation. Neuroscience 2004, 124(3):535-547.
8. Burnett L., Stein B.E., Wallace M.T. Ibotenic acid lesions of the superior colliculus disrupt multisensory orientation behaviors. Society for Neuroscience, Abstracts 2000, 26:1220. New Orleans, LA: Society for Neuroscience.
9. Calvert G.A., Spence C., Stein B.E. The handbook of multisensory processes 2004, MIT Press, Cambridge, MA.
10. Carriere B.N., Royal D.W., Perrault T.J., Morrison S.P., Vaughan J.W., Stein B.E., et al. Visual deprivation alters the development of cortical multisensory integration. Journal of Neurophysiology 2007, 98:2858-2867.
11. Edwards S.B., Ginsburgh C.L., Henkel C.K., Stein B.E. Sources of subcortical projections to the superior colliculus in the cat. The Journal of Comparative Neurology 1979, 184:309-329.
12. Ernst M.O., Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 2002, 415:429-433.
13. Frens M.A., Van Opstal A.J. Visual-auditory interactions modulate saccade-related activity in monkey superior colliculus. Brain Research Bulletin 1998, 46:211-224.
14. Fuentes-Santamaria V., Alvarado J.C., McHaffie J.G., Stein B.E. Axon morphologies and convergence patterns of projections from different sensory-specific cortices of the anterior ectosylvian sulcus onto multisensory neurons in the cat superior colliculus. Cerebral Cortex 2009, 19:2902-2915.
15. Fuentes-Santamaria V., Alvarado J.C., Stein B.E., McHaffie J.G. Cortex contacts both output neurons and nitrergic interneurons in the superior colliculus: Direct and indirect routes for multisensory integration. Cerebral Cortex 2008, 18:1640-1652.
16. Gaither N.S., Stein B.E. Reptiles and mammals use similar sensory organizations in the midbrain. Science 1979, 205:595-597.
17. Gillmeister H., Eimer M. Tactile enhancement of auditory detection and perceived loudness. Brain Research 2007, 1160:58-68.
18. Gingras G., Rowland B.A., Stein B.E. The differing impact of multisensory and unisensory integration on behavior. The Journal of Neuroscience 2009, 29:4897-4902.
19. Gori M., Del V.M., Sandini G., Burr D.C. Young children do not integrate visual and haptic form information. Current Biology 2008, 18:694-698.
20. Grantyn A., Grantyn R. Generation of grouped discharges by tectal projection cells. Archives of Italian Biology 1984, 122:59-71.
21. Hartline P.H., Kass L., Loop M.S. Merging of modalities in the optic tectum: Infrared and visual integration in rattlesnakes. Science 1978, 199:1225-1229.
22. Huerta M.F., Harting J.K. The mammalian superior colliculus: Studies of its morphology and connections. Comparative neurology of the optic tectum 1984, 687-773. Plenum Publishing Corporation, New York, NY. H. Vanegas (Ed.).
23. Jiang W., Jiang H., Rowland B.A., Stein B.E. Multisensory orientation behavior is disrupted by neonatal cortical ablation. Journal of Neurophysiology 2007, 97:557-562.
24. Jiang W., Jiang H., Stein B.E. Two corticotectal areas facilitate multisensory orientation behavior. Journal of Cognitive Neuroscience 2002, 14:1240-1255.
25. Jiang W., Jiang H., Stein B.E. Neonatal cortical ablation disrupts multisensory development in superior colliculus. Journal of Neurophysiology 2006, 95:1380-1396.
26. Jiang W., Wallace M.T., Jiang H., Vaughan J.W., Stein B.E. Two cortical areas mediate multisensory integration in superior colliculus neurons. Journal of Neurophysiology 2001, 85:506-522.
27. Kadunce D.C., Vaughan J.W., Wallace M.T., Benedek G., Stein B.E. Mechanisms of within- and cross-modality suppression in the superior colliculus2. Journal of Neurophysiology 1997, 78:2834-2847.
28. Kadunce D.C., Vaughan J.W., Wallace M.T., Stein B.E. The influence of visual and auditory receptive field organization on multisensory integration in the superior colliculus1. Experimental Brain Research 2001, 139:303-310.
29. Kao C.Q., Stein B.E., Coulter D.A. Postnatal development of excitatory synaptic function in deep layers of superior colliculus. Society for Neuroscience Abstract 1994, 20:1186.
30. King A.J., Palmer A.R. Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Experimental Brain Research 1985, 60:492-500.
31. Larson M.A., Stein B.E. The use of tactile and olfactory cues in neonatal orientation and localization of the nipple. Developmental Psychobiology 1984, 17:423-436.
32. Lomber S.G., Payne B.R., Cornwell P. Role of the superior colliculus in analyses of space: Superficial and intermediate layer contributions to visual orienting, auditory orienting, and visuospatial discriminations during unilateral and bilateral deactivations. The Journal of Comparative Neurology 2001, 441:44-57.
33. McHaffie J.G., Kruger L., Clemo H.R., Stein B.E. Corticothalamic and corticotectal somatosensory projections from the anterior ectosylvian sulcus (SIV cortex) in neonatal cats: An anatomical demonstration with HRP and 3H-leucine. The Journal of Comparative Neurology 1988, 274:115-126.
34. Meredith M.A., Nemitz J.W., Stein B.E. Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. Journal of Neuroscience 1987, 7:3215-3229.
35. Meredith M.A., Stein B.E. Interactions among converging sensory inputs in the superior colliculus. Science 1983, 221:389-391.
36. Meredith M.A., Stein B.E. Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research 1986, 365:350-354.
37. Meredith M.A., Stein B.E. Spatial determinants of multisensory integration in cat superior colliculus neurons. Journal of Neurophysiology 1996, 75:1843-1857.
38. Moschovakis A.K., Karabelas A.B. Observations on the somatodendritic morphology and axonal trajectory of intracellularly HRP-labeled efferent neurons located in the deeper layers of the superior colliculus of the cat. The Journal of Comparative Neurology 1985, 239:276-308.
39. Neil P.A., Chee-Ruiter C., Scheier C., Lewkowicz D.J., Shimojo S. Development of multisensory spatial integration and perception in humans. Developmental Science 2006, 9:454-464.
40. Peck C.K., Baro J.A. Discharge patterns of neurons in the rostral superior colliculus of cat: Activity related to fixation of visual and auditory targets. Experimental Brain Research 1997, 113:291-302.
41. Putzar L., Goerendt I., Lange K., Rosler F., Roder B. Early visual deprivation impairs multisensory interactions in humans. Nature Neuroscience 2007, 10:1243-1245.
42. Rowland B.A., Stanford T.R., Stein B.E. A model of the neural mechanisms underlying multisensory integration in the superior colliculus. Perception 2007, 36:1431-1443.
43. Royal D.W., Carriere B.N., Wallace M.T. Spatiotemporal architecture of cortical receptive fields and its impact on multisensory interactions. Experimental Brain Research 2009, 198:127-136.
44. Spence C., Pavani F., Driver J. Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cognitive, Affective and Behavioral Neuroscience 2004, 4:148-169.
45. Stanford T.R., Stein B.E. Superadditivity in multisensory integration: Putting the computation in context. Neuroreport 2007, 18:787-792.
46. Stein B.E. Development of the superior colliculus. Annual review of neuroscience 1984, 95-125. Annual Reviews, Inc, Palo Alto, CA.
47. Stein B.E., Burr D., Constantinidis C., Laurienti P.J., Alex M.M., Perrault T.J., et al. Semantic confusion regarding the development of multisensory integration: A practical solution. The European Journal of Neuroscience 2010, 31:1713-1720.
48. Stein B.E., Gaither N.S. Sensory representation in reptilian optic tectum: Some comparisons with mammals. The Journal of Comparative Neurology 1981, 202:69-87.
49. Stein B.E., Huneycutt W.S., Meredith M.A. Neurons and behavior: The same rules of multisensory integration apply. Brain Research 1988, 448:355-358.
50. Stein B.E., Labos E., Kruger L. Sequence of changes in properties of neurons of superior colliculus of the kitten during maturation. Journal of Neurophysiology 1973, 36:667-679.
51. Stein B.E., Meredith M.A. The merging of the senses 1993, MIT Press, Cambridge, MA.
52. Stein B.E., Stanford T.R. Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews. Neuroscience 2008, 9:255-266.
53. Stein B.E., Stanford T.R., Ramachandran R., Perrault T.J., Rowland B.A. Challenges in quantifying multisensory integration: Alternative criteria, models, and inverse effectiveness. Experimental Brain Research 2009, 198:113-126.
54. Wallace M.T., Carriere B.N., Perrault T.J., Vaughan J.W., Stein B.E. The development of cortical multisensory integration. The Journal of Neuroscience 2006, 26:11844-11849.
55. Wallace M.T., Hairston W.D., Stein B.E. Long-term effects of dark-rearing on multisensory processing 2001, Program No. 511.6.
56. Wallace M.T., Meredith M.A., Stein B.E. Integration of multiple sensory modalities in cat cortex. Experimental Brain Research 1992, 91:484-488.
57. Wallace M.T., Meredith M.A., Stein B.E. Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. Journal of Neurophysiology 1993, 69:1797-1809.
58. Wallace M.T., Perrault T.J., Hairston W.D., Stein B.E. Visual experience is necessary for the development of multisensory integration1. The Journal of Neuroscience 2004, 24:9580-9584.
59. Wallace M.T., Stein B.E. Cross-modal synthesis in the midbrain depends on input from cortex. Journal of Neurophysiology 1994, 71:429-432.
60. Wallace M.T., Stein B.E. Development of multisensory neurons and multisensory integration in cat superior colliculus. The Journal of Neuroscience 1997, 17:2429-2444.
61. Wallace M.T., Stein B.E. Onset of cross-modal synthesis in the neonatal superior colliculus is gated by the development of cortical influences. Journal of Neurophysiology 2000, 83:3578-3582.
62. Wallace M.T., Stein B.E. Sensory and multisensory responses in the newborn monkey superior colliculus. The Journal of Neuroscience 2001, 21:8886-8894.
63. Wallace M.T., Stein B.E. Early experience determines how the senses will interact. Journal of Neurophysiology 2007, 97:921-926.
64. Wallace M.T., Wilkinson L.K., Stein B.E. Representation and integration of multiple sensory inputs in primate superior colliculus. Journal of Neurophysiology 1996, 76:1246-1266.
65. Wilkinson L.K., Meredith M.A., Stein B.E. The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior. Experimental Brain Research 1996, 112:1-10.
66. Yu L., Rowland B.A., Stein B.E. Initiating the development of multisensory integration by manipulating sensory experience. The Journal of Neuroscience 2010, 30:4904-4913.
67. Yu L., Stein B.E., Rowland B.A. Adult plasticity in multisensory neurons: Short-term experience-dependent changes in the superior colliculus. The Journal of Neuroscience 2009, 29:15910-15922.
68. Zahar Y., Reches A., Gutfreund Y. Multisensory enhancement in the optic tectum of the barn owl: Spike count and spike timing. Journal of Neurophysiology 2009, 101:2380-2394.