Perception of auditory, visual, and egocentric spatial alignment adapts differently to changes in eye position

Journal of Neurophysiology

Volumn 103, Issue 2, 2010, Pages 1020-1035

  Cui, Qi N ^a   Razavi, Babak ^a   O'Neill, William E ^a   Paige, Gary D ^a  

^a UNIVERSITY OF ROCHESTER MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ARTICLE; AUDITORY STIMULATION; CONTROL STRATEGY; DARKNESS; DEPTH PERCEPTION; EYE POSITION; FEMALE; HEAD; HEAD POSITION; HEARING; HUMAN; HUMAN EXPERIMENT; LIGHT EMITTING DIODE; MALE; PRIORITY JOURNAL; SOUND DETECTION; SPATIAL DISCRIMINATION; VISION; VISUAL FIELD; VISUAL STIMULATION;

ADULT; EYE MOVEMENTS; FEMALE; HUMANS; MALE; ORIENTATION; SOUND LOCALIZATION; VISUAL FIELDS; VISUAL PERCEPTION;

EID: 76649086323     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00500.2009     Document Type: Article

References (84)

1. Alais D, Burr D. The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14: 257-262, 2004.
2. Arnold DB, Robinson DA. The oculomotor integrator: testing of a neural network model. Exp Brain Res 113: 57-74, 1997.
3. Battaglia PW, Jacobs RA, Aslin RN. Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am A Opt Image Sci Vis 20: 1391-1397, 2003.
4. Belendiuk K, Butler RA. Monaural localization of low-pass noise bands in the horizontal plane. J Acoust Soc Am 58: 701-705, 1975.
5. Bertelson P, Radeau M. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept Psychophys 29: 578-584, 1981.
6. Bock O. Contribution of retinal versus extraretinal signals towards visual localization in goal-directed movements. Exp Brain Res 64: 476-482, 1986.
7. Bock O. Localization of objects in the peripheral visual field. Behav Brain Res 56: 77-84, 1993.
8. Bohlander RW. Eye position and visual attention influence perceived auditory direction. Percept Mot Skills 59: 483-510, 1984.
9. Brainard MS, Knudsen EI, Esterly SD. Neural derivation of sound source location: resolution of spatial ambiguities in binaural cues. J Acoust Soc Am 91: 1015-1027, 1992.
10. Bridgeman B. A review of the role of efference copy in sensory and oculomotor control systems. Ann Biomed Eng 23: 409-422, 1995.
11. Bridgeman B, Stark L. Ocular proprioception and efference copy in registering visual direction. Vision Res 31: 1903-1913, 1991.
12. Butler RA, Humanski RA. Localization of sound in the vertical plane with and without high-frequency spectral cues. Percept Psychophys 51: 182-186, 1992.
13. Cannon SC, Robinson DA. Loss of the neural integrator of the oculomotor system from brain stem lesions in monkey. J Neurophysiol 57: 1383-1409, 1987.
14. Cohen YE, Andersen RA. Reaches to sounds encoded in an eye-centered reference frame. Neuron 27: 647-652, 2000.
15. Cui QN, Bachus L, Knoth E, O'Neill WE, Paige GD. Eye position and cross-sensory learning both contribute to prism adaptation of auditory space. Prog Brain Res 171: 265-270, 2008.
16. DiScenna AO, Das V, Zivotofsky AZ, Seidman SH, Leigh RJ. Evaluation of a video tracking device for measurement of horizontal and vertical eye rotations during locomotion. J Neurosci Methods 58: 89-94, 1995.
17. Dobreva M, O'Neill WE, Paige GD. Effect of memory and aging on auditory and visual spatial localization. Soc Neurosci Abstr 35: 283.2, 2005.
18. Ebenholtz SM. Additivity of aftereffects of maintained head and eye rotations: an alternative to recalibration. Percept Psychophys 19: 113-116, 1976.
19. Ernst MO, Banks MS. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429-433, 2002.
20. Freedman EG, Sparks DL. Eye-head coordination during head-unrestrained gaze shifts in rhesus monkeys. J Neurophysiol 77: 2328-2348, 1997.
21. Fu KM, Shah AS, O'Connell MN, McGinnis T, Eckholdt H, Lakatos P, Smiley J, Schroeder CE. Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex. J Neurophysiol 92: 3522-3531, 2004.
22. Gauthier GM, Nommay D, Vercher JL. Ocular muscle proprioception and visual localization of targets in man. Brain 113: 1857-1871, 1990.
23. Getzmann S. The effect of eye position and background noise on vertical sound localization. Hear Res 169: 130-139, 2002.
24. Goossens HH, Van Opstal AJ. Human eye-head coordination in two dimensions under different sensorimotor conditions. Exp Brain Res 114: 542-560, 1997.
25. Grantham DW. Interaural intensity discrimination: insensitivity at 1000 Hz. J Acoust Soc Am 75: 1191-1194, 1984.
26. Groh JM, Sparks DL. Two models for transforming auditory signals from head-centered to eye-centered coordinates. Biol Cybern 67: 291-302, 1992.
27. Groh JM, Trause AS, Underhill AM, Clark KR, Inati S. Eye position influences auditory responses in primate inferior colliculus. Neuron 29: 509-518, 2001.
28. Hartline PH, Vimal RL, King AJ, Kurylo DD, Northmore DP. Effects of eye position on auditory localization and neural representation of space in superior colliculus of cats. Exp Brain Res 104: 402-408, 1995.
29. Hebrank J, Wright D. Spectral cues used in the localization of sound sources on the median plane. J Acoust Soc Am 56: 1829-1834, 1974.
30. Heffner RS, Masterton RB. Sound localization in mammals: brain-stem mechanisms. In: Comparative Perception, edited by Berkley MA, Stebbins WC. New York: Wiley, 1990, p. 285-314.
31. Henning GB. Detectability of interaural delay in high-frequency complex waveforms. J Acoust Soc Am 55: 84-90, 1974.
32. Henriques DY, Klier EM, Smith MA, Lowy D, Crawford JD. Gaze-centered remapping of remembered visual space in an open-loop pointing task. J Neurosci 18: 1583-1594, 1998.
33. Heron J, Whitaker D, McGraw PV. Sensory uncertainty governs the extent of audio-visual interaction. Vision Res 44: 2875-2884, 2004.
34. Hill AL. Direction constancy. Percept Psychophys 11: 175-178, 1972.
35. Jay MF, Sparks DL. Auditory receptive fields in primate superior colliculus shift with changes in eye position. Nature 309: 345-347, 1984.
36. Jay MF, Sparks DL. Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. J Neurophysiol 57: 35-55, 1987.
37. Kalil RE, Freedman J. Persistence of ocular rotation following compensation for displaced vision. Percept Mot Skills 22: 135-139, 1966.
38. Klumpp RG, Eady HR. Some measurements of interaural time difference thresholds. J Acoust Soc Am 28: 859-860, 1956.
39. Knudsen EI, Brainard MS. Creating a unified representation of visual and auditory space in the brain. Annu Rev Neurosci 18: 19-43, 1995.
40. Lackner JR. Influence of abnormal postural and sensory conditions on human sensorimotor localization. Environ Biol Med 2: 137-177, 1976.
41. Leigh RJ, Zee DS. The Neurology of Eye Movements. New York: Oxford, 1999.
42. Lewald J. Eye-position effects in directional hearing. Behav Brain Res 87: 35-48, 1997.
43. Lewald J. The effect of gaze eccentricity on perceived sound direction and its relation to visual localization. Hear Res 115: 206-216, 1998.
44. Lewald J, Ehrenstein WH. The effect of eye position on auditory lateralization. Exp Brain Res 108: 473-485, 1996.
45. Lewald J, Ehrenstein WH. Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets. J Acoust Soc Am 104: 1586-1597, 1998.
46. Lewald J, Ehrenstein WH. Visual and proprioceptive shifts in perceived egocentric direction induced by eye-position. Vision Res 40: 539-547, 2000.
47. Lewald J, Getzmann S. Horizontal and vertical effects of eye-position on sound localization. Hear Res 213: 99-106, 2006.
48. Macpherson EA, Middlebrooks JC. Listener weighting of cues for lateral angle: the duplex theory of sound localization revisited. J Acoust Soc Am 111: 2219-2236, 2002.
49. McFadden D, Pasanen EG. Lateralization of high frequencies based on interaural time differences. J Acoust Soc Am 59: 634-639, 1976.
50. McLaughlin SC, Webster RG. Changes in straight-ahead eye position during adaptation to wedge prisms. Percept Psychophys 2: 37-44, 1967.
51. Metzger RR, Mullette-Gillman OA, Underhill AM, Cohen YE, Groh JM. Auditory saccades from different eye positions in the monkey: implications for coordinate transformations. J Neurophysiol 92: 2622-2627, 2004.
52. Middlebrooks JC, Green DM. Sound localization by human listeners. Annu Rev Psychol 42: 135-159, 1991.
53. Morgan CL. Constancy of egocentric visual direction. Percept Psychophys 23: 61-68, 1978.
54. Mullette-Gillman OA, Cohen YE, Groh JM. Eye-centered, head-centered, and complex coding of visual and auditory targets in the intraparietal sulcus. J Neurophysiol 94: 2331-2352, 2005.
55. Musicant AD, Butler RA. The influence of pinnae-based spectral cues on sound localization. J Acoust Soc Am 75: 1195-1200, 1984.
56. Nuetzel JM, Hafter ER. Discrimination of interaural delays in complex waveforms: spectral effects. J Acoust Soc Am 69: 1112-1118, 1981.
57. Peck CK, Baro JA, Warder SM. Effects of eye position on saccadic eye movements and on the neuronal responses to auditory and visual stimuli in cat superior colliculus. Exp Brain Res 103: 227-242, 1995.
58. Populin LC, Tollin DJ, Weinstein JM. Human gaze shifts to acoustic and visual targets. Ann NY Acad Sci 956: 468-473, 2002.
59. Populin LC, Tollin DJ, Yin TC. Effect of eye position on saccades and neuronal responses to acoustic stimuli in the superior colliculus of the behaving cat. J Neurophysiol 92: 2151-2167, 2004.
60. Razavi B, O'Neill WE, Paige GD. Sound localization adapts to eccentric gaze across multiple sensorimotor reference frames. Soc Neurosci Abstr 35: 852.2, 2005.
61. Razavi B, O'Neill WE, Paige GD. Auditory spatial perception dynamically realigns with changing eye position. J Neurosci 27: 10249-10258, 2007.
62. Razavi B, Rozanski MT, O'Neill WE, Paige GD. Sound localization using gaze pointing under different sensori-motor contexts. Assoc Res Otolaryngol Abstr 29: 149, 2006.
63. Recanzone GH. Rapidly induced auditory plasticity: the ventriloquism aftereffect. Proc Natl Acad Sci USA 95: 869-875, 1998.
64. Redding GM, Rossetti Y, Wallace B. Applications of prism adaptation: a tutorial in theory and method. Neurosci Biobehav Rev 29: 431-444, 2005.
65. Richmond FJ, Johnston WS, Baker RS, Steinbach MJ. Palisade endings in human extraocular muscles. Invest Ophthalmol Vis Sci 25: 471-476, 1984.
66. Roffler SK, Butler RA. Factors that influence the localization of sound in the vertical plane. J Acoust Soc Am 43: 1255-1259, 1968.
67. Ruskell GL. Extraocular muscle proprioceptors and proprioception. Prog Retin Eye Res 18: 269-291, 1999.
68. Russo GS, Bruce CJ. Frontal eye field activity preceding aurally guided saccades. J Neurophysiol 71: 1250-1253, 1994.
69. Skavenski AA. Inflow as a source of extraretinal eye position information. Vision Res 12: 221-229, 1972.
70. Steinbach MJ. Proprioceptive knowledge of eye position. Vision Res 27: 1737-1744, 1987.
71. Stricanne B, Andersen RA, Mazzoni P. Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. J Neurophysiol 76: 2071-2076, 1996.
72. Tomlinson RD, Bahra PS. Combined eye-head gaze shifts in the primate. II. Interactions between saccades and the vestibuloocular reflex. J Neurophysiol 56: 1558-1570, 1986.
73. Van Opstal AJ, Hepp K, Suzuki Y, Henn V. Influence of eye position on activity in monkey superior colliculus. J Neurophysiol 74: 1593-1610, 1995.
74. Von Noorden GK. Burian-von Noorden's Binocular Vision and Ocular Motility: Theory and Management of Strabismus. St. Louis, MO: Mosby, 1985.
75. Weerts TC, Thurlow WR. The effects of eye position and expectation on sound localization. Percept Psychophys 9: 35-39, 1971.
76. Werner-Reiss U, Kelly KA, Trause AS, Underhill AM, Groh JM. Eye position affects activity in primary auditory cortex of primates. Curr Biol 13: 554-562, 2003.
77. Wightman FL, Kistler DJ. The dominant role of low-frequency interaural time differences in sound localization. J Acoust Soc Am 91: 1648-1661, 1992.
78. Wooster M. Certain factors in the development of a new spatial coordination. Psychol Monogr 32: 1-96, 1923.
79. Yao L, Peck CK. Saccadic eye movements to visual and auditory targets. Exp Brain Res 115: 25-34, 1997.
80. Yost WA, Dye RH Jr. Discrimination of interaural differences of level as a function of frequency. J Acoust Soc Am 83: 1846-1851, 1988.
81. Zella JC, Brugge JF, Schnupp JW. Passive eye displacement alters auditory spatial receptive fields of cat superior colliculus neurons. Nat Neurosci 4: 1167-1169, 2001.
82. Zwiers MP, Van Opstal AJ, Paige GD. Plasticity in human sound localization induced by compressed spatial vision. Nat Neurosci 6: 175-181, 2003.
83. Zwiers MP, Versnel H, Van Opstal AJ. Involvement of monkey inferior colliculus in spatial hearing. J Neurosci 24: 4145-4156, 2004.
84. Zwislocki J, Feldman RS. Just noticeable differences in dichotic phase. J Acoust Soc Am 28: 860-864, 1956.