Multisensory processing after a brain damage: Clues on post-injury crossmodal plasticity from neuropsychology

Neuroscience and Biobehavioral Reviews

Volumn 37, Issue 3, 2013, Pages 269-278

  Bolognini, Nadia ^a,b   Convento, Silvia ^a   Rossetti, Angela ^a   Merabet, Lotfi B ^c  

^a UNIVERSITY OF MILANO BICOCCA   (Italy)

^b ISTITUTO AUXOLOGICO ITALIANO   (Italy)

^c HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Brain damage; Multisensory; Neuropsychology; Perception; Plasticity

Indexed keywords

BRAIN DAMAGE; BRAIN REGION; DISEASE ASSOCIATION; HUMAN; NERVE CELL PLASTICITY; NEUROPSYCHOLOGY; NONHUMAN; PERCEPTIVE THRESHOLD; PRIORITY JOURNAL; PROPRIOCEPTION; REVIEW; SENSORIMOTOR INTEGRATION; SENSORY DYSFUNCTION; TACTILE DISCRIMINATION; VISUAL DISCRIMINATION; VISUAL INFORMATION;

ANIMALS; BRAIN INJURIES; HUMANS; NERVE NET; NEURONAL PLASTICITY; PERCEPTION; SENSATION;

EID: 84872713465     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2012.12.006     Document Type: Review

References (116)

1. Alais D., Newell F.N., Mamassian P. Multisensory processing in review: from physiology to behaviour. Seeing Perceiving 2011, 23:3-38.
2. Amedi A., von Kriegstein K., van Atteveldt N.M., Beauchamp M.S., Naumer M.J. Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research 2005, 166:559-571.
3. Aspell J.E., Lavanchy T., Lenggenhager B., Blanke O. Seeing the body modulates audiotactile integration. European Journal of Neuroscience 2010, 31:1868-1873.
4. Azanon E., Longo M.R., Soto-Faraco S., Haggard P. The posterior parietal cortex remaps touch into external space. Current Biology 2010, 20:1304-1309.
5. Bartolomeo P. The quest for the 'critical lesion site' in cognitive deficits: problems and perspectives. Cortex 2011, 47:1010-1012.
6. Beauchamp M.S., Ro T. Neural substrates of sound-touch synesthesia after a thalamic lesion. Journal of Neuroscience 2008, 28:13696-13702.
7. Bell A.H., Corneil B.D., Meredith M.A., Munoz D.P. The influence of stimulus properties on multisensory processing in the awake primate superior colliculus. Canadian Journal of Experimental Psychology 2001, 55:123-132.
8. Bertelson P., Pavani F., Ladavas E., Vroomen J., de Gelder B. Ventriloquism in patients with unilateral visual neglect. Neuropsychologia 2000, 38:1634-1642.
9. Bhaskaran R., Kumar A., Nayar P.C. Autoscopy in hemianopic field. Journal of Neurology, Neurosurgery and Psychiatry 1990, 53:1016-1017.
10. Blanke O., Landis T., Spinelli L., Seeck M. Out-of-body experience and autoscopy of neurological origin. Brain 2004, 127:243-258.
11. Blanke O., Arzy S. The out-of-body experience: disturbed self-processing at the temporo-parietal junction. Neuroscientist 2005, 11:16-24.
12. Blanke O., Mohr C. Out-of-body experience, heautoscopy, and autoscopic hallucination of neurological origin implications for neurocognitive mechanisms of corporeal awareness and self-consciousness. Brain Research. Brain Research Reviews 2005, 50:184-199.
13. Bolognini N., Frassinetti F., Serino A., Ladavas E. Acoustical vision of below threshold stimuli: interaction among spatially converging audiovisual inputs. Experimental Brain Research 2005, 160:273-282.
14. Bolognini N., Rasi F., Coccia M., Ladavas E. Visual search improvement in hemianopic patients after audio-visual stimulation. Brain 2005, 128:2830-2842.
15. Bolognini N., Rasi F., Ladavas E. Visual localization of sounds. Neuropsychologia 2005, 43:1655-1661.
16. Bolognini N., Leo F., Passamonti C., Stein B.E., Ladavas E. Multisensory-mediated auditory localization. Perception 2007, 36:1477-1485.
17. Bolognini N., Maravita A. Proprioceptive alignment of visual and somatosensory maps in the posterior parietal cortex. Current Biology 2007, 17:1890-1895.
18. Bolognini N., Senna I., Maravita A., Pascual-Leone A., Merabet L.B. Auditory enhancement of visual phosphene perception: the effect of temporal and spatial factors and of stimulus intensity. Neuroscience Letters 2010, 477:109-114.
19. Bolognini N., Maravita A. Uncovering multisensory processing through non-invasive brain stimulation. Frontiers in Psychology 2011, 2:46.
20. Bolognini N., Ladavas E., Farne A. Spatial perspective and coordinate systems in autoscopy: a case report of a fantome de profil in occipital brain damage. Journal of Cognitive Neuroscience 2011, 23:1741-1751.
21. Bolognini N., Olgiati E., Xaiz A., Posteraro L., Ferraro F., Maravita A. Touch to see: neuropsychological evidence of a sensory mirror system for touch. Cerebral Cortex 2011, 22:2055-2064.
22. Bolognini N., Casanova D., Maravita A., Vallar G. Bisecting real and fake body parts: effects of prism adaptation after right brain damage. Frontiers in Human Neuroscience 2012, 6:154.
23. Bonath B., Noesselt T., Martinez A., Mishra J., Schwiecker K., Heinze H.J., Hillyard S.A. Neural basis of the ventriloquist illusion. Current Biology 2007, 17:1697-1703.
24. Brown L.E., Kroliczak G., Demonet J.F., Goodale M.A. A hand in blindsight: hand placement near target improves size perception in the blind visual field. Neuropsychologia 2008, 46:786-802.
25. Brozzoli C., Dematte M.L., Pavani F., Frassinetti F., Farne A. Neglect and extinction: within and between sensory modalities. Restorative Neurology and Neuroscience 2006, 24:217-232.
26. Brozzoli C., Pavani F., Urquizar C., Cardinali L., Farne A. Grasping actions remap peripersonal space. Neuroreport 2009, 20:913-917.
27. Brugger P. From phantom limb to phantom body: varieties of extracorporeal awareness. Human Body Perception from the Inside Out 2006, 171-209. Oxford University Press, New York. G. Knoblich, I. Thornton, M. Grosjean, M. Shiffrar (Eds.).
28. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 2000, 10:649-657.
29. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cerebral Cortex 2001, 11:1110-1123.
30. Calvert G., Spence C., Stein B.E. The Handbook of Multisensory Processes 2004, MIT Press, Cambridge, MA, USA.
31. Campbell R., Garwood J., Franklin S., Howard D., Landis T., Regards M. Neuropsychological studies of auditory-visual fusion illusions. Four case studies and their implications. Neuropsychologia 1990, 28:787-902.
32. Campbell R. The processing of audio-visual speech: empirical and neural bases. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences 2008, 363:1001-1010.
33. Cappe C., Morel A., Barone P., Rouiller E.M. The thalamocortical projection systems in primate: an anatomical support for multisensory and sensorimotor interplay. Cerebral Cortex 2009, 19:2025-2037.
34. Cappe C., Thelen A., Romei V., Thut G., Murray M.M. Looming signals reveal synergistic principles of multisensory integration. Journal of Neuroscience 2012, 32:1171-1182.
35. Chokron S., Dupierrix E., Tabert M., Bartolomeo P. Experimental remission of unilateral spatial neglect. Neuropsychologia 2007, 45:3127-3148.
36. Cipriani G., Picchi L., Vedovello M., Nuti A., Fiorino M.D. The phantom and the supernumerary phantom limb: historical review and new case. Neuroscience Bulletin 2011, 27:359-365.
37. Critchley M. The Parietal Lobes 1953, Collier Macmillan, London.
38. Driver J., Noesselt T. Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 2008, 57:11-23.
39. Duhamel J.R., Colby C.L., Goldberg M.E. Ventral intraparietal area of the macaque: congruent visual and somatic response properties. Journal of Neurophysiology 1998, 79:126-136.
40. Ehrsson H.H. The experimental induction of out-of-body experiences. Science 2007, 317:1048.
41. Ernst M.O., Bulthoff H.H. Merging the senses into a robust percept. Trends in Cognitive Sciences 2004, 8:162-169.
42. Falchier A., Clavagnier S., Barone P., Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. Journal of Neuroscience 2002, 22:5749-5759.
43. Frassinetti F., Bolognini N., Bottari D., Bonora A., Ladavas E. Audiovisual integration in patients with visual deficit. Journal of Cognitive Neuroscience 2005, 17:1442-1452.
44. Gainotti G., Ferraccioli M., Quaranta D., Marra C. Cross-modal recognition disorders for persons and other unique entities in a patient with right fronto-temporal degeneration. Cortex 2008, 44:238-248.
45. Gentileschi V., Sperber S., Spinnler H. Crossmodal agnosia for familiar people as a consequence of right infero-polar temporal atrophy. Cognitive Neuropsychology 2001, 18:439-463.
46. Ghazanfar A.A., Schroeder C.E. Is neocortex essentially multisensory?. Trends in Cognitive Sciences 2006, 10:278-285.
47. Graziano M.S., Gross C.G. A bimodal map of space: somatosensory receptive fields in the macaque putamen with corresponding visual receptive fields. Experimental Brain Research 1993, 97:96-109.
48. Graziano M.S., Gross C.G. The representation of extrapersonal space: a possible role for bimodal, visuo-tactile neurons. The Cognitive Neurosciences 1995, 1021-1034. MIT, Press, Cambridge, MA, USA. M.S. Gazzaniga (Ed.).
49. Graziano M.S. A system of multimodal areas in the primate brain. Neuron 2001, 29:4-6.
50. Hackett T.A., De La Mothe L.A., Ulbert I., Karmos G., Smiley J., Schroeder C.E. Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane. Journal of Comparative Neurology 2007, 502:924-952.
51. Halligan P.W., Fink G.R., Marshall J.C., Vallar G. Spatial cognition: evidence from visual neglect. Trends in Cognitive Sciences 2003, 7:125-133.
52. Hamilton R.H., Shenton J.T., Coslett H.B. An acquired deficit of audiovisual speech processing. Brain and Language 2006, 98:66-73.
53. Hari R., Hanninen R., Makinen T., Jousmaki V., Forss N., Seppa M., Salonen O. Three hands: fragmentation of human bodily awareness. Neuroscience Letters 1998, 240:131-134.
54. Holmes N.P., Spence C. Multisensory integration: space, time and superadditivity. Current Biology 2005, 15:R762-R764.
55. Hoover A.E., Demonet J.F., Steeves J.K. Superior voice recognition in a patient with acquired prosopagnosia and object agnosia. Neuropsychologia 2010, 48:3725-3732.
56. Howard I.P., Templeton W.B. Human Spatial Orientation 1966, Wiley, London.
57. Hubbard E.M., Ramachandran V.S. Neurocognitive mechanisms of synaesthesia. Neuron 2005, 48:509-520.
58. Ionta S., Heydrich L., Lenggenhager B., Mouthon M., Fornari E., Chapuis D., Gassert R., Blanke O. Multisensory mechanisms in temporo-parietal cortex support self-location and first-person perspective. Neuron 2011, 70:363-374.
59. Jacobs S., Brozzoli C., Farnè A. Neglect: a multisensory deficit?. Neuropsychologia 2012, 50:1029-1044.
60. Jones E.G., Powell T.P. An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain 1970, 93:793-820.
61. Kerkhoff G. Modulation and rehabilitation of spatial neglect by sensory stimulation. Progress in Brain Research 2003, 142:257-271.
62. Kerkhoff G., Schenk T. Rehabilitation of neglect: an update. Neuropsychologia 2012, 50:1072-1079.
63. Khateb A., Simon S.R., Dieguez S., Lazeyras F., Momjian-Mayor I., Blanke O., et al. Seeing the phantom: a functional magnetic resonance imaging study of a supernumerary phantom limb. Annals of Neurology 2009, 65:698-705.
64. Ladavas E., Farne A. Visuo-tactile representation of near-the-body space. Journal of Physiology, Paris 2004, 98:161-170.
65. Ladavas E. Multisensory-based approach to the recovery of unisensory deficit. Annals of the New York Academy of Sciences 2008, 1124:98-110.
66. Lenggenhager B., Tadi T., Metzinger T., Blanke O. Video ergo sum: manipulating bodily self-consciousness. Science 2007, 317:1096-1099.
67. Leo F., Bolognini N., Passamonti C., Stein B.E., Ladavas E. Cross-modal localization in hemianopia: new insights on multisensory integration. Brain 2008, 131:855-865.
68. Luria A.R. Higher Cortical Functions in Man 1962, Basic Books, New York.
69. Macaluso E., Frith C.D., Driver J. Modulation of human visual cortex by crossmodal spatial attention. Science 2000, 289:1206-1208.
70. Macaluso E. Multisensory processing in sensory-specific cortical areas. Neuroscientist 2006, 12:327-338.
71. Macaluso E., Maravita A. The representation of space near the body through touch and vision. Neuropsychologia 2010, 48:782-795.
72. Mancini F., Bricolo E., Vallar G. Multisensory integration in the Muller-Lyer illusion: from vision to haptics. Quarterly Journal of Experimental Psychology 2011, 63:818-830.
73. McDonald J.J., Teder-Salejarvi W.A., Di Russo F., Hillyard S.A. Neural substrates of perceptual enhancement by cross-modal spatial attention. Journal of Cognitive Neuroscience 2003, 15:10-19.
74. McGonigle D.J., Hanninen R., Salenius S., Hari R., Frackowiak R.S., Frith C.D. Whose arm is it anyway? An fMRI case study of supernumerary phantom limb. Brain 2002, 125:1265-1274.
75. Merabet L.B., Pascual-Leone A. Neural reorganization following sensory loss: the opportunity of change. Nature Reviews Neuroscience 2010, 11:44-52.
76. Naghavi H.R., Eriksson J., Larsson A., Nyberg L. The claustrum/insula region integrates conceptually related sounds and pictures. Neuroscience Letters 2007, 422:77-80.
77. Nagy A., Eordegh G., Paroczy Z., Markus Z., Benedek G. Multisensory integration in the basal ganglia. European Journal of Neuroscience 2006, 24:917-924.
78. Noesselt T., Tyll S., Boehler C.N., Budinger E., Heinze H.J., Driver J. Sound-induced enhancement of low-intensity vision: multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. Journal of Neuroscience 2010, 30:13609-13623.
79. Nudo R.J. Plasticity. NeuroRx 2006, 3:420-427.
80. Pascual-Leone A., Amedi A., Fregni F., Merabet L.B. The plastic human brain cortex. Annual Review of Neuroscience 2005, 28:377-401.
81. Passamonti C., Frissen I., Ladavas E. Visual recalibration of auditory spatial perception: two separate neural circuits for perceptual learning. European Journal of Neuroscience 2009, 30:1141-1150.
82. Pavani F., Ladavas E., Driver J. Auditory and multisensory aspects of visuospatial neglect. Trends in Cognitive Sciences 2003, 7:407-414.
83. Pavani F., Husain M., Ladavas E., Driver J. Auditory deficits in visuospatial neglect patients. Cortex 2004, 40:347-365.
84. Phan M.L., Schendel K.L., Recanzone G.H., Robertson L.C. Auditory and visual spatial localization deficits following bilateral parietal lobe lesions in a patient with Balint's syndrome. Journal of Cognitive Neuroscience 2000, 12:583-600.
85. Pourtois G., de Gelder B., Bol A., Crommelinck M. Perception of facial expressions and voices and of their combination in the human brain. Cortex 2005, 41:49-59.
86. Radeau M., Bertelson P. The after-effects of ventriloquism. Quarterly Journal of Experimental Psychology 1974, 26:63-71.
87. Rich A.N., Mattingley J.B. Anomalous perception in synaesthesia: a cognitive neuroscience perspective. Nature Reviews Neuroscience 2002, 3:43-52.
88. Ro T., Farne A., Johnson R.M., Wedeen V., Chu Z., Wang Z.J., Hunter J.V., Beauchamp M.S. Feeling sounds after a thalamic lesion. Annals of Neurology 2007, 62:433-441.
89. Robertson L.C. Binding, spatial attention and perceptual awareness. Nature Reviews Neuroscience 2003, 4:93-102.
90. Rockland K.S., Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. International Journal of Psychophysiology 2003, 50:19-26.
91. Sack A.T. Parietal cortex and spatial cognition. Behavioural Brain Research 2009, 202:153-161.
92. Sagiv N., Ward J. Crossmodal interactions: lessons from synesthesia. Progress in Brain Research 2006, 155:259-271.
93. Schendel K., Robertson L.C. Reaching out to see: arm position can attenuate human visual loss. Journal of Cognitive Neuroscience 2004, 16:935-943.
94. Schmid G., Ziegler W. Audio-visual matching of speech and non-speech oral gestures in patients with aphasia and apraxia of speech. Neuropsychologia 2006, 44:546-555.
95. Schroeder C.E., Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Current Opinion in Neurobiology 2005, 15:454-458.
96. Seigneuric A., Durand K., Jiang T., Baudouin J.Y., Schaal B. The nose tells it to the eyes: crossmodal associations between olfaction and vision. Perception 2010, 39:1541-1554.
97. Seltzer B., Pandya D.N. Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey. Brain Research 1978, 149:1-24.
98. Serino A., Farne A., Rinaldesi M.L., Haggard P., Ladavas E. Can vision of the body ameliorate impaired somatosensory function?. Neuropsychologia 2007, 45:1101-1107.
99. Shore S.E. Multisensory integration in the dorsal cochlear nucleus: unit responses to acoustic and trigeminal ganglion stimulation. European Journal of Neuroscience 2005, 21:3334-3348.
100. Shore S.E., Koehler S., Oldakowski M., Hughes L.F., Syed S. Dorsal cochlear nucleus responses to somatosensory stimulation are enhanced after noise-induced hearing loss. European Journal of Neuroscience 2008, 27:155-168.
101. Smith D.T., Lane A.R., Schenk T. Arm position does not attenuate visual loss in patients with homonymous field deficits. Neuropsychologia 2008, 46:2320-2325.
102. Spence C. Crossmodal spatial attention. Annals of the New York Academy of Sciences 2010, 1191:182-200.
103. Sposito A.V., Bolognini N., Vallar G., Posteraro L., Maravita A. The spatial encoding of body parts in patients with neglect and neurologically unimpaired participants. Neuropsychologia 2010, 48:334-340.
104. Stein B.E., Meredith M.A. The Merging of the Senses 1993, MIT Press, Cambridge, MA, USA.
105. Stein B.E. Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Experimental Brain Research 1998, 123:124-135.
106. Stein B.E., Stanford T.R. Multisensory integration: current issues from the perspective of the single neuron. Nature Reviews Neuroscience 2008, 9:255-266.
107. Taylor K.I., Moss H.E., Stamatakis E.A., Tyler L.K. Binding crossmodal object features in perirhinal cortex. Proceedings of the National Academy of Sciences of the United States of America 2006, 103:8239-8244.
108. Taylor K.I., Stamatakis E.A., Tyler L.K. Crossmodal integration of object features: voxel-based correlations in brain-damaged patients. Brain 2009, 132:671-683.
109. Valenza N., Murray M.M., Ptak R., Vuilleumier P. The space of senses: impaired crossmodal interactions in a patient with Balint syndrome after bilateral parietal damage. Neuropsychologia 2004, 42:1737-1748.
110. Vallar G., Guariglia C., Rusconi M.L. Modulation of the neglect syndrome by sensory stimulation. Parietal Lobe Contributions to Orientation in 3D Space 1997, 555-578. Springer-Verlag, Heidelberg. P. Their, H.O. Karnath (Eds.).
111. Vallar G. Spatial hemineglect in humans. Trends in Cognitive Sciences 1998, 2:87-97.
112. Vallar G., Ronchi R. Somatoparaphrenia: a body delusion. A review of the neuropsychological literature. Experimental Brain Research 2009, 192:533-551.
113. Vallar G., Bolognini N. Unilateral spatial neglect. Oxford Handbook of Attention 2012, Oxford University Press, Oxford. A.C. Nobre, S. Kastner (Eds.).
114. Welch R.B., Warren D.H. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 1980, 88:638-667.
115. Zamboni G., Budriesi C., Nichelli P. Seeing oneself: a case of autoscopy. Neurocase 2005, 11:212-215.
116. Zihl J., Kennard C. Disorders of higher visual functions. Neurological Disorders: Course and Treatment 1996, 201-212. Academic Press, San Diego. T. Brandt, L.R. Caplan, J. Dichgans, H.C. Diener, C. Kennard (Eds.).