Bayesian integration of visual and auditory signals for spatial localization

Journal of the Optical Society of America A: Optics and Image Science, and Vision

Volumn 20, Issue 7, 2003, Pages 1391-1397

  Battaglia, Peter W ^a   Jacobs, Robert A ^a   Aslin, Richard N ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; INFORMATION ANALYSIS; MAXIMUM LIKELIHOOD ESTIMATION; RELIABILITY; SIGNAL PROCESSING;

AUDITORY SIGNALS;

VISION;

EID: 0042575594     PISSN: 10847529     EISSN: None     Source Type: Journal    
DOI: 10.1364/JOSAA.20.001391     Document Type: Article

References (24)

1. B. E. Stein and M. A. Meredith, The Merging of the Senses (MIT Press, Cambridge, Mass, 1993).
2. R. Held, "Shifts in binaural localization after prolonged exposure to atypical combinations of stimuli," Am. J. Psychol. 68, 526-548 (1955).
3. H. L. Pick, Jr., D. H. Warren, and J. C. Hay, "Sensory conflict in judgements of spatial direction," Percept. Psychophys 6, 203-205 (1969).
4. R. B. Welch and D. H. Warren, "Immediate perceptual response to intersensory discrepancy," Psychol. Bull. 88, 638-667 (1980).
5. E. I. Knudsen and M. S. Brainard, "Creating a unified representation of visual and auditory space in the brain," Annu. Rev. Neurosci. 18, 19-43 (1995).
6. M. S. Brainard and E. I. Knudsen, "Sensitive periods for visual calibration of the auditory space map in the barn owl optic tectum," J. Neurosci. 18, 3929-3942 (1998).
7. J. J. Clark and A. L. Yuille, Data Fusion for Sensory Information Processing Systems (Kluwer Academic, Norwell, Mass, 1990).
8. Z. Ghahramani, Computation and Psychophysics of Sensorimotor Integration, Ph.D. dissertation (Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Mass., 1995).
9. R. A. Jacobs, "Optimal integration of texture and motion cues to depth," Vision Res. 39, 3621-3629 (1999).
10. M. O. Ernst and M. S. Banks, "Humans integrate visual and haptic information in a statistically optimal fashion," Nature 415, 429-433 (2002).
11. D. C. Knill and J. Saunders, "Humans optimally weight stereo and texture cues to estimate surface slant," J. Vision 2, 400 (2002).
12. R. E. Kalman and R. S. Bucy, "New results in linear filtering and prediction problems," J. Basic Eng. Ser. D 83, 95-108 (1961).
13. G. C. Goodwin and K. S. Sin, Adaptive Filtering Prediction and Control (Prentice-Hall, Englewood Cliffs, N.J., 1984).
14. A. L. Yuille and H. H. Bülthoff, "Bayesian decision theory and psychophysics," in Perception as Bayesian Inference, D. C. Knill and W. Richards, eds. (Cambridge U. Press, Cambridge, UK, 1996), pp. 123-161.
15. F. Wightman, Department of Psychology, University of Wisconsin, Madison, Wisconsin (personal communication, 2000).
16. J. S. Tittle, V. J. Perotti, and J. F. Norman, "Integration of binocular stereopsis and structure from motion in the discrimination of noisy surfaces," J. Exp. Psychol. Hum. Percept. Perform. 23, 1035-1049 (1997).
17. S. Deneve, P. E. Latham, and A. Pouget, "Reading population codes: a neural implementation of ideal observers," Nat. Neurosci. 2, 740-745 (1999).
18. A. Pouget, R. S. Zemel, and P. Dayan, "Information processing with population codes," Nature Rev. Neurosci. 1, 125-132 (2000).
19. S. Deneve, P. E. Latham, and A. Pouget, "Efficient computation and cue integration with noisy population codes," Nature Neurosci. 4, 826-831 (2001).
20. S. Wu and S. Amari, "Neural implementation of Bayesian inference in population codes," in Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, eds. (MIT Press, Cambridge, Mass., 2002).
21. L. Shams, Y. Kamitani, and S. Shimojo, "What you see is what you hear," Nature 408, 788 (2000).
22. S. Shimojo and L. Shams, "Sensory modalities are not separate modalities: plasticity and interactions," Curr. Opin. Neurobiol. 11, 505-509 (2001).
23. H. S. Smallman, I. Fine, and D. I. A. MacLeod, "Pre- and post-operative characterization of visual function before and after the removal of congenital bilateral cataracts," Vision Res. 42, 191-210 (2002).
24. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian Data Analysis (Chapman & Hall, London, 1995).