Auditory-visual spatial integration: A new psychophysical approach using laser pointing to acoustic targets

Journal of the Acoustical Society of America

Volumn 104, Issue 3 I, 1998, Pages 1586-1597

  Lewald, Jörg ^a   Ehrenstein, Walter H ^b  

^a RUHR UNIVERSITY BOCHUM   (Germany)

^b Institut fur Arbeitsphysiologie   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY RESPONSE; FEMALE; GAZE; HUMAN; HUMAN EXPERIMENT; MALE; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; SOUND PRESSURE; SPATIAL DISCRIMINATION; STIMULUS RESPONSE; VISUAL SYSTEM;

ACOUSTICS; ADULT; AUDITORY PERCEPTION; FEMALE; HUMANS; LASERS; MALE; PSYCHOPHYSICS; VISUAL PERCEPTION;

EID: 0031687683     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.424371     Document Type: Article

References (74)

1. Andersen, R. A., Essick, G. K., and Siegel, R. M. (1985). "Encoding of spatial location by posterior parietal neurons," Nature (London) 230, 456-458.
2. Andersen, R. A., Bracewell, R. M., Barash, S., Gnadt, J. W., and Fogassi, L. (1990). "Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of macaque," J. Neurosci. 10, 1176-1196.
3. Blauert, J. (1974). Räumliches Hören (Hirzel, Stuttgart).
4. Bock, O. (1986). "Contribution of retinal versus extraretinal signals toward visual localization in goal-directed movements," Exp. Brain Res. 64, 476-482.
5. Bock, O. (1993). "Localization of objects in the peripheral visual field," Behav. Brain Res. 56, 77-84.
6. Boerger, G. (1965). "Die Lokalisation von Gaußtönen," dissertation, Technische Universität, Berlin.
7. Bohlander, R. W. (1984). "Eye position and visual attention influence perceived auditory direction," Percept. Motor Skills 59, 483-510.
8. Brainard, M. S. (1994). "Neural substrates of sound localization," Curr. Opin. Neurobiol. 4, 557-562.
9. Coren, S. (1993). "The lateral preference inventory for measurement of handedness, footedness, eyedness, and earedness: Norms for young adults," Bull. Psychonom. Soc. 31, 1-3.
10. Cullen, Jr., J. K., Collins, M. J., Dobie, T. G., Rappold, P. W. (1992). "The effects of perceived motion on sound-source lateralization," Aviat., Space Environ. Med. 63, 498-504.
11. Ehrenstein, W. H., and Amold-Schulz-Gahmen, B. E. (1993). "Fragebogen zur Bevorzugung von Auge, Ohr, Hand und Fuß: German adaptation of Coren's (1993) inventory," Institute's Report of the Institut für Arbeitsphysiologie an der Universität Dortmund.
12. Ehrenstein, W. H., and Reinhardt-Rutland, A. H. (1996a). "A cross-modal aftereffect: Auditory displacement following adaptation to visual motion," Percept. Motor Skills 82, 23-26.
13. Ehrenstein, W. H., and Reinhardt-Rutland, A. H. (1996b). "Adaptation to auditory motion in the free-field: Aftereffects depend on carrier frequency," Pflügers Arch. 432, R136.
14. Fogassi, L., Gallese, V., di Pellegrino, G., Fadiga, L., Gentilucci, M., Luppino, G., Matelli, M., Pedotti, A., and Rizzolatti, G. (1992). "Space coding by premotor cortex," Exp. Brain Res. 89, 686-690.
15. Galletti, C., Battaglini, P. P., and Fattori, P. (1993). "Parietal neurons encoding spatial locations in craniotopic coordinates," Exp. Brain Res. 96, 221-229.
16. Gentilucci, M., Scandolara, C., Pigarev, I. N., and Rizzolatti, G. (1983). "Visual responses in the postarcuate cortex (area 6) of the monkey that are independent of eye position," Exp. Brain Res. 50, 464-468.
17. Gilkey, R. H., and Anderson, T. R. (1995). "The accuracy of absolute localization judgments for speech stimuli," J. Vestib. Res. 5, 487-497.
18. Goldstein, K., and Rosenthal-Veit, O. (1926). "Über akustische Lokalisation und deren Beeinflußbarkeit durch andere Sinnesreize," Psychol. Forsch. 8, 318-335.
19. Grantham, D. W. (1984). "Interaural intensity discrimination: Insensitivity at 1000 Hz," J. Acoust. Soc. Am. 75, 1191-1194.
20. Guski, R. (1990). "Auditory localization: Effects of reflecting surfaces," Perception 19, 819-830.
21. Hartline, P. H., Pandey Vimal, R. L., King, A. J., Kurylo, D. D., and Northmore, D. P. M. (1995). "Effects of eye position on auditory localization and neural representation of space in superior colliculus of cats," Exp. Brain Res. 104, 402-408.
22. Heffner, R. S., and Heffner, H. E. (1992). "Visual factors in sound localization in mammals," J. Comp. Neurol. 317, 219-232.
23. Hornbostel, E. M. von (1926). "Das räumliche Hören," in Handbuch der normalen und pathologischen Physiologie, edited by A. Bethe (Springer-Verlag, Berlin), Vol. 11, pp. 601-618.
24. Jackson, C. V. (1953). "Visual factors in auditory localization," Q. J. Exp. Psych. 5, 52-65.
25. Jay, M. F., and Sparks, D. L. (1984). "Auditory receptive fields in primate superior colliculus shift with changes in eye position," Nature (London) 309, 345-347.
26. Jay, M. F., and Sparks, D. L. (1987). "Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals," J. Neurophysiol. 57, 35-55.
27. Jay, M. F., and Sparks, D. L. (1989). "Localization of auditory and visual targets for the initiation of saccadic eye movements," in Comparative Perception, edited by M. A. Berkley and W. C. Stebbins (Wiley, New York), Vol. 1, pp. 351-374.
28. King, A. J., and Hutchings, M. E. (1987). "Spatial response properties of acoustically responsive neurons in the superior colliculus of the ferret: a map of auditory space," J. Neurophysiol. 57, 596-624.
29. King, A. J., and Palmer, A. R. (1983). "Cells responsive to free-field auditory stimuli in guinea-pig superior colliculus: Distribution and response properties," J. Physiol. (London) 342, 361-383.
30. Klemm, O. (1910). "Lokalisation von Sinneseindrücken bei disparaten Nebenreizen," Psychologische Studien 5, 73-162.
31. Klumpp, R. G., and Eady, H. R. (1956). "Some measurements of interaural time difference thresholds," J. Acoust. Soc. Am. 28, 859-864.
32. Knudsen, E. I. (1982). "Auditory and visual maps of space in the optic tectum of the owl," J. Neurosci. 2, 1177-1194.
33. Konishi, M. (1986). "Centrally synthesized maps of sensory space," Trends Neurosci. 9, 163-168.
34. Lewald, J. (1997). "Eye-position effects in directional hearing," Behav. Brain Res. 87, 35-48.
35. Lewald, J. (1998). "The effect of gaze eccentricity on perceived sound direction and its relation to visual localization," Hearing Res. 115, 206-216.
36. Lewald, J., and Ehrenstein, W. H. (1996a). "The effect of eye position on auditory lateralization," Exp. Brain Res. 108, 473-485; 110, 322 (Erratum).
37. Lewald, J., and Ehrenstein, W. H. (1996b). "Auditory-visual shift in localization depending on gaze direction," NeuroReport 7, 1929-1932.
38. Lewald, J., and Ehrenstein, W. H. (1998). "Influence of head-to-trunk position on sound lateralization," Exp. Brain Res. (in press).
39. Lueck, C. J., Crawford, T. J., Savage, C. J., and Kennard, C. (1990). "Auditory-visual interaction in the generation of saccades in man," Exp. Brain Res. 82, 149-157.
40. Makous, J. C., and Middlebrooks, J. C. (1990). "Two-dimensional sound localization by human listeners," J. Acoust. Soc. Am. 87, 2188-2200.
41. Matsumoto, M. (1897). "Researches on acoustic space," Yale Psychol. Lab. Studies 5, 1-75.
42. Mazzoni, P., Bracewell, M., Barash, S., and Andersen, R. A. (1996). "Spatially tuned auditory responses in area LIP of Macaques performing delayed memory saccades to acoustic targets," J. Neurophysiol. 75, 1233-1241.
43. McFadden, D., and Pasanen, E. G. (1976). "Lateralization at high frequencies based on interaural time differences," J. Acoust. Soc. Am. 59, 634-639.
44. Middlebrooks, J. C., and Knudsen, E. I. (1984). "A neural code for auditory space in the cat's superior colliculus," J. Neurosci. 4, 2621-2634.
45. Morgan, C. L. (1978). "Constancy of egocentric visual direction," Percept. Psychophys. 23, 61-68.
46. Oldfield, S. R., and Parker, S. P. A. (1984). "Acuity of sound localisation: A topography of auditory space. I. Normal hearing conditions," Perception 13, 581-600.
47. Peck, C. K., Baro, J. A., and Warder, S. M. (1995). "Effects of eye position on saccadic eye movements and on the neuronal responses to auditory and visual stimuli in cat superior colliculus," Exp. Brain Res. 103, 227-242.
48. Perrott, D. R. (1993). "Auditory and visual localization: Two modalities, one world," in Proc. AES 12th International Conference (Snekkersten, Copenhagen), pp. 221-231.
49. Perrott, D. R., Ambarsoom, H., and Tucker, J. (1987). "Changes in head position as a measure of auditory localization performance: Auditory psychomotor coordination under monaural and binaural listening conditions," J. Acoust. Soc. Am. 82, 1637-1645.
50. Perrott, D. R., Sadralodabai, T., Saberi, K., and Strybel, T. Z. (1991). "Aurally aided visual search in the central visual field: Effects of visual load and visual enhancement of the target," Hum. Factors 33, 389-400.
51. Pierce, A. H. (1901). Studies in Auditory and Visual Space Perception (Longmans, New York), Chap. 6, pp. 130-144.
52. Pöppel, E. (1973). "Comment on 'Visual system's view of acoustic space'," Nature (London) 243, 231.
53. Preibisch-Effenberger, R. (1966). Die Schallokalisationsfähigkeit des Menschen und ihre audiomeirische Verwendbarkeit zur klinischen Diagnostik (Habilitationsschrift, Medizinische Akademie, Dresden).
54. Rakerd, B., and Hartmann, W. M. (1985). "Localization of sound in rooms, II: The effects of a single reflecting surface," J. Acoust. Soc. Am. 78, 524-533.
55. Ryan, T. A., and Schehr, F. (1941). "The influence of eye movement and position on auditory localization," Am. J. Psychol. 54, 243-252.
56. Sandel, T. T., Teas, D. C., Feddersen, W. E., and Jeffress, L. A. (1955). "Localization of sound from single and paired sources," J. Acoust. Soc. Am. 27, 842-852.
57. Sparks, D. L., and Nelson, J. S. (1987). "Sensory and motor maps in the mammalian superior colliculus," Trends Neurosci. 10, 312-317.
58. Stein, B. E., London, N., Wilkinson, L. K., and Price, D. D. (1996). "Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis," J. Cogn. Neurosci. 8, 497-506.
59. Stricanne, B., Andersen, R. A., and Mazzoni, P. (1996). "Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP," J. Neurophysiol. 76, 2071-2077.
60. Thomas, G. J. (1941). "Experimental study of the influence of vision on sound localization," J. Exp. Psychol. 28, 163-177.
61. Walls, G. L. (1951). "A theory of ocular dominance," A.M.A. Arch. Ophthalm. 45, 387-412.
62. Weerts, T. C., and Thurlow, W. R. (1971). "The effects of eye position and expectation on sound localization," Percept. Psychophys. 9, 35-39.
63. Welch, R. B., and Warren, D. H. (1980). "Immediate perceptual response to intersensory discrepancy," Psychol. Bull. 88, 638-667.
64. Weyand, T. G., and Malpeli, J. G. (1993). "Responses of neurons in primary visual cortex are modulated by eye position," J. Neurophysiol. 69, 2258-2260.
65. Whittington, D. A., Hepp-Reymond, M.-C., and Flood, W. (1981). "Eye and head movements to auditory targets," Exp. Brain Res. 41, 358-363.
66. Wightman, F. L., and Kistler, D. J. (1989). "Headphone simulation of free-field listening. II: Psychophysical validation," J. Acoust. Soc. Am. 85, 868-878.
67. Withington, D. J., Mark, R. F., Thornton, S. K., Liu, G. B., and Hill, K. G. (1995). "Neural responses to free-field auditory stimulation in the superior colliculus of the wallaby (Macropus eugenii)," Exp. Brain Res. 105, 233-240.
68. Witkin, H. A., Wapner, S., and Leventhal, T. (1952). "Sound localization with conflicting visual and auditory cues," J. Exp. Psychol. 43, 58-67.
69. Yao, L., and Peck, C. K. (1997). "Saccadic eye movements to visual and auditory targets," Exp. Brain Res. 115, 25-34.
70. Yost, W. A., and Dye, Jr., R. H. (1988). "Discrimination of interaural differences of level as a function of frequency," J. Acoust. Soc. Am. 83, 1846-1851.
71. Zahn, J. R., Abel, L. A., and Dell'Osso, L. F. (1978). "Audio-ocular response characteristics," Sens. Processes 2, 32-37.
72. Zambarbieri, D., Schmid, R., Prablanc, C., and Magenes, G. (1981). "Characteristics of eye movements evoked by the presentation of acoustic targets," in Progress in Oculomotor Research, edited by A. F. Fuchs and W. Becker (Elsevier, New York), pp. 559-566.
73. Zambarbieri, D., Schmid, R., Magenes, G., and Prablanc, C. (1982). "Saccadic responses evoked by presentation of visual and auditory targets," Exp. Brain Res. 47, 417-427.
74. Zwislocki, J., and Feldman, R. S. (1956). "Just noticeable differences in dichotic phase," J. Acoust. Soc. Am. 28, 860-864.