Effect of audiovisual training on monaural spatial hearing in horizontal plane

PLoS ONE

Volumn 6, Issue 3, 2011, Pages

  Strelnikov, Kuzma ^a,b,c   Rosito, Maxime ^a,b   Barone, Pascal ^a,b  

^a Brain and Cognition Research Center in Toulouse   (France)

^b CNRS   (France)

^c TOULOUSE UNIVERSITY HOSPITAL   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MONAURAL HEARING; NORMAL HUMAN; PERCEPTION; SIGNAL DETECTION; SOUND DETECTION; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL ADAPTATION; VISUAL FEEDBACK; VISUAL STIMULATION; DEPTH PERCEPTION; HEARING; PHYSIOLOGY;

ADULT; AUDIOVISUAL AIDS; FEMALE; HEARING; HUMANS; MALE; SPACE PERCEPTION; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 79953205200     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0018344     Document Type: Article

References (88)

1. Middlebrooks JC, Green DM, (1991) Sound localization by human listeners. Annu Rev Psychol 42: 135-159.
2. Colletti V, Fiorino FG, Carner M, Rizzi R, (1988) Investigation of the long-term effects of unilateral hearing loss in adults. Br J Audiol 22: 113-118.
3. Slattery WH 3rd, Middlebrooks JC, (1994) Monaural sound localization: acute versus chronic unilateral impairment. Hear Res 75: 38-46.
4. Shub DE, Carr SP, Kong Y, Colburn HS, (2008) Discrimination and identification of azimuth using spectral shape. J Acoust Soc Am 124: 3132-3141.
5. Van Wanrooij MM, Van Opstal AJ, (2004) Contribution of head shadow and pinna cues to chronic monaural sound localization. J Neurosci 24: 4163-4171.
6. Luntz M, Brodsky A, Watad W, Weiss H, Tamir A, et al. (2005) Sound localization in patients with unilateral cochlear implants. Cochlear Implants Int 6: 1-9.
7. Nava E, Bottari D, Bonfioli F, Beltrame MA, Pavani F, (2009) Spatial hearing with a single cochlear implant in late-implanted adults. Hear Res 255: 91-98.
8. Bolognini N, Frassinetti F, Serino A, Ladavas E, (2005) "Acoustical vision" of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp Brain Res 160: 273-282.
9. Bavelier D, Neville HJ, (2002) Cross-modal plasticity: where and how? Nat Rev Neurosci 3: 443-452.
10. McDonald JJ, Teder-Salejarvi WA, Hillyard SA, (2000) Involuntary orienting to sound improves visual perception. Nature 407: 906-908.
11. Stein BE, Meredith MA, (1993) The Merging of the Senses Cambridge, MA MIT Press.
12. Ladavas E, (2008) Multisensory-based approach to the recovery of unisensory deficit. Ann N Y Acad Sci 1124: 98-110.
13. Frassinetti F, Bolognini N, Bottari D, Bonora A, Ladavas E, (2005) Audiovisual integration in patients with visual deficit. J Cogn Neurosci 17: 1442-1452.
14. Seitz AR, Kim R, Shams L, (2006) Sound facilitates visual learning. Current Biology 16: 1422-1427.
15. Lippert M, Logothetis NK, Kayser C, (2007) Improvement of visual contrast detection by a simultaneous sound. Brain Res 1173: 102-109.
16. Weinberger NM, (2004) Specific long-term memory traces in primary auditory cortex. Nat Rev Neurosci 5: 279-290.
17. Cappe C, Barone P, (2005) Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur J Neurosci 22: 2886-2902.
18. Cappe C, Morel A, Barone P, Rouiller EM, (2009) The thalamocortical projection systems in primate: an anatomical support for multisensory and sensorimotor interplay. Cereb Cortex 19: 2025-2037.
19. Lewald J, Ehrenstein WH, (1998) Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets. J Acoust Soc Am 104: 1586-1597.
20. Butler RA, (1987) An analysis of the monaural displacement of sound in space. Percept Psychophys 41: 1-7.
21. Kumpik DP, Kacelnik O, King AJ, (2010) Adaptive reweighting of auditory localization cues in response to chronic unilateral earplugging in humans. J Neurosci 30: 4883-4894.
22. Wright BA, Zhang Y, (2006) A review of learning with normal and altered sound-localization cues in human adults. Int J Audiol 45 (Suppl 1): S92-98.
23. Musicant AD, Butler RA, (1984) The psychophysical basis of monaural localization. Hear Res 14: 185-190.
24. Hofman PM, Van Opstal AJ, (1998) Spectro-temporal factors in two-dimensional human sound localization. J Acoust Soc Am 103: 2634-2648.
25. Van Wanrooij MM, Van Opstal AJ, (2005) Relearning sound localization with a new ear. J Neurosci 25: 5413-5424.
26. Zwiers MP, Van Opstal AJ, Paige GD, (2003) Plasticity in human sound localization induced by compressed spatial vision. Nat Neurosci 6: 175-181.
27. Van Wanrooij MM, Van Opstal AJ, (2007) Sound localization under perturbed binaural hearing. J Neurophysiol 97: 715-726.
28. Ison JR, Agrawal P, (1998) The effect of spatial separation of signal and noise on masking in the free field as a function of signal frequency and age in the mouse. J Acoust Soc Am 104: 1689-1695.
29. Darwin CJ, Hukin RW, (2004) Limits to the role of a common fundamental frequency in the fusion of two sounds with different spatial cues. J Acoust Soc Am 116: 502-506.
30. Goldstone RL, (1998) Perceptual learning. Annu Rev Psychol 49: 585-612.
31. Seitz A, Watanabe T, (2005) A unified model for perceptual learning. Trends Cogn Sci 9: 329-334.
32. Hervais-Adelman A, Davis MH, Johnsrude IS, Carlyon RP, (2008) Perceptual learning of noise vocoded words: effects of feedback and lexicality. J Exp Psychol Hum Percept Perform 34: 460-474.
33. Jenkins WM, Masterton RB, (1982) Sound localization: effects of unilateral lesions in central auditory system. J Neurophysiol 47: 987-1016.
34. Kavanagh GL, Kelly JB, (1987) Contribution of auditory cortex to sound localization by the ferret (Mustela putorius). J Neurophysiol 57: 1746-1766.
35. Heffner HE, Heffner RS, (1990) Effect of bilateral auditory cortex lesions on sound localization in Japanese macaques. J Neurophysiol 64: 915-931.
36. Welch RB, Warren DH, (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP, editors. Handbook of perception and human performance New York Wiley pp. 1-36.
37. Lehmann S, Murray MM, (2005) The role of multisensory memories in unisensory object discrimination. Brain Res Cogn Brain Res 24: 326-334.
38. Lovelace CT, Stein BE, Wallace MT, (2003) An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection. Brain Res Cogn Brain Res 17: 447-453.
39. Shams L, Seitz AR, (2008) Benefits of multisensory learning. Trends Cogn Sci 12: 411-417.
40. Shams L, Kim R, (2010) Crossmodal influences on visual perception. Phys Life Rev.
41. Kim RS, Seitz AR, Shams L, (2008) Benefits of stimulus congruency for multisensory facilitation of visual learning. PLoS One 3: e1532.
42. Alais D, Cass J, (2010) Multisensory perceptual learning of temporal order: audiovisual learning transfers to vision but not audition. PLoS One 5: e11283.
43. Kawase T, Sakamoto S, Hori Y, Maki A, Suzuki Y, et al. (2009) Bimodal audio-visual training enhances auditory adaptation process. Neuroreport 20: 1231-1234.
44. Beer AL, Watanabe T, (2009) Specificity of auditory-guided visual perceptual learning suggests crossmodal plasticity in early visual cortex. Exp Brain Res 198: 353-361.
45. Knudsen EI, Brainard MS, (1995) Creating a unified representation of visual and auditory space in the brain. Annu Rev Neurosci 18: 19-43.
46. King AJ, Schnupp JW, Carlile S, Smith AL, Thompson ID, (1996) The development of topographically-aligned maps of visual and auditory space in the superior colliculus. Prog Brain Res 112: 335-350.
47. Withington-Wray DJ, Binns KE, Keating MJ, (1990) The developmental emergence of a map of auditory space in the superior colliculus of the guinea pig. Brain Res Dev Brain Res 51: 225-236.
48. Stein BE, Perrault TJ Jr, Stanford TR, Rowland BA, (2009) Postnatal experiences influence how the brain integrates information from different senses. Front Integr Neurosci 3: 21.
49. Middlebrooks JC, Xu L, Furukawa S, Macpherson EA, (2002) Cortical neurons that localize sounds. Neuroscientist 8: 73-83.
50. Clarey JC, Barone P, Imig TJ, (1992) Physiology of Thalamus and Cortex. In: Fay R, Popper A, editors. The Mammalian Auditory Pathway: Neurophysiology New York Springer-Verlag pp. 232-334.
51. King AJ, Schnupp JW, Doubell TP, (2001) The shape of ears to come: dynamic coding of auditory space. Trends Cogn Sci 5: 261-270.
52. Malhotra S, Hall AJ, Lomber SG, (2004) Cortical control of sound localization in the cat: unilateral cooling deactivation of 19 cerebral areas. J Neurophysiol 92: 1625-1643.
53. Nodal FR, Kacelnik O, Bajo VM, Bizley JK, Moore DR, et al. (2010) Lesions of the auditory cortex impair azimuthal sound localization and its recalibration in ferrets. J Neurophysiol 103: 1209-1225.
54. Samson FK, Clarey JC, Barone P, Imig TJ, (1993) Effects of ear plugging on single-unit azimuth sensitivity in cat primary auditory cortex. I. Evidence for monaural directional cues. J Neurophysiol 70: 492-511.
55. Neff WD, Casseday JH, (1977) Effects of unilateral ablation of auditory cortex on monaural cat's ability to localize sound. J Neurophysiol 40: 44-52.
56. King AJ, (2009) Visual influences on auditory spatial learning. Philos Trans R Soc Lond B Biol Sci 364: 331-339.
57. Gilbert CD, Sigman M, Crist RE, (2001) The neural basis of perceptual learning. Neuron 31: 681-697.
58. Schoups A, Vogels R, Qian N, Orban G, (2001) Practising orientation identification improves orientation coding in V1 neurons. Nature 412: 549-553.
59. Li W, Piech V, Gilbert CD, (2004) Perceptual learning and top-down influences in primary visual cortex. Nat Neurosci 7: 651-657.
60. Hua T, Bao P, Huang CB, Wang Z, Xu J, et al. (2010) Perceptual learning improves contrast sensitivity of V1 neurons in cats. Curr Biol 20: 887-894.
61. Schwartz S, Maquet P, Frith C, (2002) Neural correlates of perceptual learning: a functional MRI study of visual texture discrimination. Proc Natl Acad Sci U S A 99: 17137-17142.
62. Falchier A, Clavagnier S, Barone P, Kennedy H, (2002) Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22: 5749-5759.
63. Falchier A, Schroeder CE, Hackett TA, Lakatos P, Nascimento-Silva S, et al. (2010) Projection from visual areas V2 and prostriata to caudal auditory cortex in the monkey. Cereb Cortex 20: 1529-1538.
64. Rockland KS, Ojima H, (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50: 19-26.
65. Fu S, Fan S, Chen L, (2003) Event-related potentials reveal involuntary processing of orientation changes in the visual modality. Psychophysiology 40: 770-775.
66. Kayser J, Tenke CE, Gates NA, Bruder GE, (2007) Reference-independent ERP old/new effects of auditory and visual word recognition memory: Joint extraction of stimulus- and response-locked neuronal generator patterns. Psychophysiology 44: 949-967.
67. Wang Y, Celebrini S, Trotter Y, Barone P, (2008) Visuo-auditory interactions in the primary visual cortex of the behaving monkey: electrophysiological evidence. BMC Neurosci 9: 79.
68. Schroeder CE, Foxe J, (2005) Multisensory contributions to low-level, 'unisensory' processing. Curr Opin Neurobiol 15: 454-458.
69. Giard MH, Peronnet F, (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11: 473-490.
70. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, et al. (2000) Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10: 77-83.
71. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, et al. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14: 115-128.
72. Sperdin HF, Cappe C, Foxe JJ, Murray MM, (2009) Early, low-level auditory-somatosensory multisensory interactions impact reaction time speed. Front Integr Neurosci 3: 2.
73. Merabet LB, Hamilton R, Schlaug G, Swisher JD, Kiriakopoulos ET, et al. (2008) Rapid and reversible recruitment of early visual cortex for touch. PLoS One 3: e3046.
74. Barone P, (2010) Is the primary visual cortex multisensory? Comment on "Crossmodal influences on visual perception" by Prof. Ladan Shams. Phys Life Rev 7: 291-292; discussion 295-298.
75. Kaas JH, Hackett TA, (2000) How the visual projection map instructs the auditory computational map. J Comp Neurol 421: 143-145.
76. Rauschecker JP, Tian B, (2000) Mechanisms and streams for processing of "what" and "where" in auditory cortex. Proc Natl Acad Sci U S A 97: 11800-11806.
77. Rauschecker JP, (1991) Mechanisms of visual plasticity: Hebb synapses, NMDA receptors, and beyond. Physiol Rev 71: 587-615.
78. Smiley JF, Hackett TA, Ulbert I, Karmas G, Lakatos P, et al. (2007) Multisensory convergence in auditory cortex, I. Cortical connections of the caudal superior temporal plane in macaque monkeys. J Comp Neurol 502: 894-923.
79. Hackett TA, Stepniewska I, Kaas JH, (1999) Prefrontal connections of the parabelt auditory cortex in macaque monkeys. Brain Res 817: 45-58.
80. Pandya DN, Hallett M, Kmukherjee SK, (1969) Intra- and interhemispheric connections of the neocortical auditory system in the rhesus monkey. Brain Res 14: 49-65.
81. Strelnikov K, Rouger J, Lagleyre S, Fraysse B, Deguine O, et al. (2009) Improvement in speech-reading ability by auditory training: Evidence from gender differences in normally hearing, deaf and cochlear implanted subjects. Neuropsychologia 47: 972-979.
82. Rouger J, Lagleyre S, Fraysse B, Deneve S, Deguine O, et al. (2007) Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci U S A 104: 7295-7300.
83. Giraud AL, Price CJ, Graham JM, Truy E, Frackowiak RS, (2001) Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron 30: 657-663.
84. Grantham DW, Ricketts TA, Ashmead DH, Labadie RF, Haynes DS, (2008) Localization by postlingually deafened adults fitted with a single cochlear implant. Laryngoscope 118: 145-151.
85. Frassinetti F, Pavani F, Ladavas E, (2002) Acoustical vision of neglected stimuli: interaction among spatially converging audiovisual inputs in neglect patients. J Cogn Neurosci 14: 62-69.
86. Leo F, Bolognini N, Passamonti C, Stein BE, Ladavas E, (2008) Cross-modal localization in hemianopia: new insights on multisensory integration. Brain 131: 855-865.
87. Carpenter J, Bithell J, (2000) Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med 19: 1141-1164.
88. Swets JA, Green DM, Getty DJ, Swets JB, (1978) Signal detection and identification at successive stages of observation. Percept Psychophys 23: 275-289.