Crossmodal enhancement of visual orientation discrimination by looming sounds requires functional activation of primary visual areas: A case study

Neuropsychologia

Volumn 56, Issue 1, 2014, Pages 350-358

  Cecere, Roberto ^a,b,c   Romei, Vincenzo ^d   Bertini, Caterina ^a,b   Làdavas, Elisabetta ^a,b  

^a UNIVERSITY OF BOLOGNA   (Italy)

^b UNIVERSITY OF BOLOGNA   (Italy)

^c UNIVERSITY OF GLASGOW   (United Kingdom)

^d UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Cortical blindness; Looming sounds; Multisensory integration; Visual detection; Visual orientation discrimination

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CASE REPORT; CASE STUDY; HUMAN; MALE; OCCIPITAL LOBE; PERIMETRY; SECONDARY VISUAL CORTEX; SOUND; STIMULUS RESPONSE; STRIATE CORTEX; VISION; VISUAL CORTEX; VISUAL FIELD; VISUAL ORIENTATION; VISUAL ORIENTATION DISCRIMINATION; VISUAL STIMULATION; VISUAL SYSTEM; YOUNG ADULT; ACCURACY; ASSOCIATION; BRAIN DAMAGE; CEREBRAL BLINDNESS; CONTROLLED STUDY; LOOMING SOUND; NUCLEAR MAGNETIC RESONANCE IMAGING; THREAT; VISUAL DISCRIMINATION; VISUAL FIELD DEFECT;

CORTICAL BLINDNESS; LOOMING SOUNDS; MULTISENSORY INTEGRATION; VISUAL DETECTION; VISUAL ORIENTATION DISCRIMINATION;

ACOUSTIC STIMULATION; DISCRIMINATION (PSYCHOLOGY); HEART ARREST; HUMANS; HYPOXIA, BRAIN; MALE; ORIENTATION; REACTION TIME; SOUND; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 84896268090     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2014.02.008     Document Type: Article

References (62)

1. Bertini C., Leo F., Avenanti A., Ladavas E. Independent mechanisms for ventriloquism and multisensory integration as revealed by theta-burst stimulation. European Journal of Neuroscience 2010, 31:1791-1799.
2. Bolognini N., Frassinetti F., Serino A., Ladavas E. "Acoustical vision" of below threshold stimuli: Interaction among spatially converging audiovisual inputs. Experimental Brain Research Experimentelle Hirnforschung Expérimentation Cérébrale 2005, 160:273-282.
3. Bolognini N., Leo F., Passamonti C., Stein B.E., Ladavas E. Multisensory-mediated auditory localization. Perception 2007, 36:1477-1485.
4. Bolognini N., Rasi F., Coccia M., Ladavas E. Visual search improvement in hemianopic patients after audio-visual stimulation. Brain 2005, 128:2830-2842.
5. Bolognini N., Senna I., Maravita A., Pascual-Leone A., Merabet L.B. Auditory enhancement of visual phosphene perception: The effect of temporal and spatial factors and of stimulus intensity. Neuroscience Letters. 2010, 477:109-114.
6. Boyer J.L., Harrison S., Ro T. Unconscious processing of orientation and color without primary visual cortex. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:16875-16879.
7. Cappe C., Thelen A., Romei V., Thut G., Murray M.M. Looming signals reveal synergistic principles of multisensory integration. Journal of Neuroscience 2012, 32:1171-1182.
8. Cappe C., Thut G., Romei V., Murray M.M. Selective integration of auditory-visual looming cues by humans. Neuropsychologia 2009, 47:1045-1052.
9. Cappe C., Thut G., Romei V., Murray M.M. Auditory-visual multisensory interactions in humans: Timing, topography, directionality, and sources. Journal of Neuroscience 2010, 30:12572-12580.
10. de Haas B., Cecere R., Cullen H., Driver J., Romei V. The duration of a co-occurring sound modulates visual detection performance in humans. PLoS One 2013, 8:e54789.
11. Driver J., Noesselt T. Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Journal of Neuroscience 2008, 57:11-23.
12. Driver J., Spence C. Crossmodal attention. Current Opinion in Neurobiology 1998, 8:245-253.
13. Ernst M.O., Bulthoff H.H. Merging the senses into a robust percept. Trends in Cognitive Sciences 2004, 8:162-169.
14. Frassinetti F., Bolognini N., Bottari D., Bonora A., Ladavas E. Audiovisual integration in patients with visual deficit. Journal of Cognitive Neuroscience 2005, 17:1442-1452.
15. Frassinetti F., Pavani F., Ladavas E. Acoustical vision of neglected stimuli: Interaction among spatially converging audiovisual inputs in neglect patients. Journal of Cognitive Neuroscience 2002, 14:62-69.
16. Ghazanfar A.A., Neuhoff J.G., Logothetis N.K. Auditory looming perception in rhesus monkeys. Proceedings of the National Academy of Sciences of the United States of America 2002, 99:15755-15757.
17. Ghazanfar A.A., Schroeder C.E. Is neocortex essentially multisensory?. Trends in Cognitive Sciences 2006, 10:278-285.
18. Giard M.H., Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 1999, 11:473-490.
19. Hackett T.A. Multisensory convergence in the thalamus. The new handbook of multisensory processing 2012, 49-66. MIT Press, Cambridge, MA. B.E. Stein (Ed.).
20. Hall D.A., Moore D.R. Auditory neuroscience: The salience of looming sounds. Current Biology 2003, 13:R91-R93.
21. Hubel D.H., Weisel T.N. Receptive fields of single neurons in the cat[U+05F3]s striate cortex. Journal of Physiology 1959, 160:106-154.
22. Hubel D.H., Wiesel T.N. Ferrier lecture. Functional architecture of macaque monkey visual cortex. Proceedings of the Royal Society of London B Biological Sciences 1977, 198:1-59.
23. Kayser C., Logothetis N.K. Do early sensory cortices integrate cross-modal information?. Brain Structure & Function 2007, 212:121-132.
24. Kayser C., Petkov C.I., Augath M., Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex. Journal of Neuroscience 2007, 27:1824-1835.
25. Kleiner M., Brainard D., Pelli D. What[U+05F3]s new in Psychtoolbox-3?. Perception 2007, 36:14.
26. Làdavas E. Multisensory-based approach to the recovery of unisensory deficit. Annals of the New York Academy of Sciences 2008, 1124:98-110.
27. Leo F., Bolognini N., Passamonti C., Stein B.E., Ladavas E. Cross-modal localization in hemianopia: New insights on multisensory integration. Brain 2008, 131:855-865.
28. Leo F., Romei V., Freeman E., Ladavas E., Driver J. Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds. Experimental Brain Research Experimentelle Hirnforschung Expérimentation Cérébrale 2011, 213:193-201.
29. MacLeod A., Summerfield Q. A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: Rationale, evaluation, and recommendations for use. British Journal of Audiology 1990, 24:29-43.
30. Maier J.X., Chandrasekaran C., Ghazanfar A.A. Integration of bimodal looming signals through neuronal coherence in the temporal lobe. Current Biology 2008, 18:963-968.
31. Maier J.X., Ghazanfar A.A. Looming biases in monkey auditory cortex. Journal of Neuroscience 2007, 27:4093-4100.
32. Maier J.X., Neuhoff J.G., Logothetis N.K., Ghazanfar A.A. Multisensory integration of looming signals by rhesus monkeys. Neuron 2004, 43:177-181.
33. Martuzzi R., Murray M.M., Michel C.M., Thiran J.P., Maeder P.P., Clarke S., Meuli R.A. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cerebal Cortex 2007, 17:1672-1679.
34. McDonald J.J., Teder-Salejarvi W.A., Hillyard S.A. Involuntary orienting to sound improves visual perception. Nature 2000, 407:906-908.
35. Meredith M.A., Stein B.E. Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research 1986, 365:350-354.
36. Miller J. Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology 1982, 14:247-279.
37. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Research Cognitive Brain Research 2002, 14:115-128.
38. Morrongiello B.A., Hewitt K.L., Gotowiec A. Infants' discrimination of relative distance in the auditory modality: Approaching versus receding sound sources. Infant Behavior and Development 1991, 14:187-208.
39. Murray M.M., Cappe C., Romei V., Martuzzi R., Thut G. Auditory-visual multisensory interactions in humans: Synthesis and controversies. The new handbook of multisensory processing 2012, The MIT Press, Cambridge (MA), USA. B. Stein (Ed.).
40. Nagy A., Eordegh G., Paroczy Z., Markus Z., Benedek G. Multisensory integration in the basal ganglia. European Journal of Neuroscience 2006, 24:917-924.
41. Neuhoff J.G. Perceptual bias for rising tones. Nature 1998, 395:123-124.
42. Nishijo H., Ono T., Nishino H. Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. Journal of Neuroscience 1988, 8:3570-3583.
43. Noesselt T., Tyll S., Boehler C.N., Budinger E., Heinze H.J., Driver J. Sound-induced enhancement of low-intensity vision: Multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. Journal of Neuroscience 2010, 30:13609-13623.
44. Passamonti C., Bertini C., Ladavas E. Audio-visual stimulation improves oculomotor patterns in patients with hemianopia. Neuropsychologia 2009, 47:546-555.
45. Passamonti C., Frissen I., Ladavas E. Visual recalibration of auditory spatial perception: Two separate neural circuits for perceptual learning. European Journal of Neuroscience 2009, 30:1141-1150.
46. Raij T., Ahveninen J., Lin F.H., Witzel T., Jaaskelainen I.P., Letham B., Israeli E., Sahyoun C., Vasios C., Stufflebeam S., Hamalainen M., Belliveau J.W. Onset timing of cross-sensory activations and multisensory interactions in auditory and visual sensory cortices. European Journal of Neuroscience 2010, 31:1772-1782.
47. Ramos-Estebanez C., Merabet L.B., Machii K., Fregni F., Thut G., Wagner T.A., Romei V., Amedi A., Pascual-Leone A. Visual phosphene perception modulated by subthreshold crossmodal sensory stimulation. Journal of Neuroscience 2007, 27:4178-4181.
48. Romei V., Murray M.M., Cappe C., Thut G. Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Current Biology 2009, 19:1799-1805.
49. Romei V., Murray M.M., Merabet L.B., Thut G. Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: Implications for multisensory interactions. Journal of Neuroscience 2007, 27:11465-11472.
50. Rosenblum L.D., Carello C., Pastore R.E. Relative effectiveness of three stimulus variables for locating a moving sound source. Perception 1987, 16:175-186.
51. Schouten B., Troje N.F., Vroomen J., Verfaillie K. The effect of looming and receding sounds on the perceived in-depth orientation of depth-ambiguous biological motion figures. PLoS One 2011, 6:e14725.
52. Schroger E., Widmann A. Speeded responses to audiovisual signal changes result from bimodal integration. Psychophysiology 1998, 35:755-759.
53. Serino A., Cecere R., Dundon N., Bertini C., Sanchez-Castaneda C., Laỳdavas E. When apperceptive agnosia is explained by a deficit of primary visual processing. Cortex 2014, 52:12-27. 10.1016/j.cortex.2013.12.011.
54. Seifritz E., Neuhoff J.G., Bilecen D., Scheffler K., Mustovic H., Schachinger H., Elefante R., Di Salle F. Neural processing of auditory looming in the human brain. Current Biology 2002, 12:2147-2151.
55. Shams L., Kim R. Crossmodal influences on visual perception. Physics of Life Reviews 2010, 7:269-284.
56. Simpson W.E., Stanton L.D. Head movement does not facilitate perception of the distance of a source of sound. American Journal of Psychology 1973, 86:151-159.
57. Stein B.E., Meredith M.A. The merging of the senses 1993, MIT Press, Cambridge, MA.
58. Stein B.E., Meredith M.A., Wallace M.T. The visually responsive neuron and beyond: Multisensory integration in cat and monkey. Progress in Brain Research 1993, 95:79-90.
59. Tyll S., Bonath B., Schoenfeld M.A., Heinze H.J., Ohl F.W., Noesselt T. Neural basis of multisensory looming signals. Neuroimage 2013, 65:13-22.
60. Van der Burg E., Talsma D., Olivers C.N., Hickey C., Theeuwes J. Early multisensory interactions affect the competition among multiple visual objects. Neuroimage 2011, 55:1208-1218.
61. Vroomen J., de Gelder B. Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception and Performance 2000, 26:1583-1590.
62. Wang Y., Celebrini S., Trotter Y., Barone P. Visuo-auditory interactions in the primary visual cortex of the behaving monkey: Electrophysiological evidence. BMC Neuroscience 2008, 9:79.