Why seeing is believing: Merging auditory and visual worlds

Neuron

Volumn 48, Issue 3, 2005, Pages 489-496

  Witten, Ilana B ^a   Knudsen, Eric I ^a  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY STIMULATION; NONHUMAN; PRIORITY JOURNAL; REVIEW; VISUAL STIMULATION;

ANIMALS; AUDITORY CORTEX; AUDITORY PERCEPTION; HEARING; HUMANS; MODELS, NEUROLOGICAL; NEURONAL PLASTICITY; NEURONS; VISION; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 27644567170     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2005.10.020     Document Type: Review

References (52)

1. D. Alais, and D. Burr The ventriloquist effect results from near-optimal bimodal integration Curr. Biol. 14 2004 257 262
2. T.J. Anastasio, P.E. Patton, and K. Belkacem-Boussaid Using Bayes' rule to model multisensory enhancement in the superior colliculus Neural Comput. 12 2000 1165 1187
3. G. Aschersleben, and P. Bertelson Temporal ventriloquism: crossmodal interaction on the time dimension. 2. Evidence from sensorimotor synchronization Int. J. Psychophysiol. 50 2003 157 163
4. P.W. Battaglia, R.A. Jacobs, and R.N. Aslin Bayesian integration of visual and auditory signals for spatial localization J. Opt. Soc. Am. A Opt. Image Sci. Vis. 20 2003 1391 1397
5. P. Bertelson, and M. Radeau Cross-modal bias and perceptual fusion with auditory-visual spatial discordance Percept. Psychophys. 29 1981 578 584
6. M.S. Brainard, and E.I. Knudsen Experience-dependent plasticity in the inferior colliculus: a site for visual calibration of the neural representation of auditory space in the barn owl J. Neurosci. 13 1993 4589 4608
7. L.K. Canon Intermodality inconsistency of input and directed attention as determinants of the nature of adaptation J. Exp. Psychol. 84 1970 141 147
8. S. Cash, and R. Yuste Linear summation of excitatory inputs by CA1 pyramidal neurons Neuron 22 1999 383 394
9. W.G. Cochran Problems arising in the analysis of a series of similar experiments J. R. Stat. Soc. [Ser A] Suppl. 4 1937 102 118
10. W.M. DeBello, and E.I. Knudsen Multiple sites of adaptive plasticity in the owl's auditory localization pathway J. Neurosci. 24 2004 6853 6861
11. W.M. DeBello, D.E. Feldman, and E.I. Knudsen Adaptive axonal remodeling in the midbrain auditory space map J. Neurosci. 21 2001 3161 3174
12. S. Deneve, and A. Pouget Bayesian multisensory integration and cross-modal spatial links J. Physiol. (Paris) 98 2004 249 258
13. S. Deneve, P.E. Latham, and A. Pouget Efficient computation and cue integration with noisy population codes Nat. Neurosci. 4 2001 826 831
14. M.O. Ernst, and M.S. Banks Humans integrate visual and haptic information in a statistically optimal fashion Nature 415 2002 429 433
15. M.O. Ernst, and H.H. Bulthoff Merging the senses into a robust percept Trends Cogn. Sci. 8 2004 162 169
16. D.E. Feldman, and E.I. Knudsen An anatomical basis for visual calibration of the auditory space map in the barn owl's midbrain J. Neurosci. 17 1997 6820 6837
17. Y. Gutfreund, W. Zheng, and E.I. Knudsen Gated visual input to the central auditory system Science 297 2002 1556 1559
18. D.O. Hebb The Organization of Behavior; a Neuropsychological Theory 1949 Wiley New York
19. I.P. Howard, and W.B. Templeton Human Spatial Orientation 1966 Wiley London, New York
20. P.S. Hyde, and E.I. Knudsen Topographic projection from the optic tectum to the auditory space map in the inferior colliculus of the barn owl J. Comp. Neurol. 421 2000 146 160
21. C.E. Jack, and W.R. Thurlow Effects of degree of visual association and angle of displacement on the "ventriloquism" effect Percept. Mot. Skills 37 1973 967 979
22. R.A. Jacobs Optimal integration of texture and motion cues to depth Vision Res. 39 1999 3621 3629
23. D.C. Kadunce, J.W. Vaughan, M.T. Wallace, G. Benedek, and B.E. Stein Mechanisms of within- and cross-modality suppression in the superior colliculus J. Neurophysiol. 78 1997 2834 2847
24. A.J. King The superior colliculus Curr. Biol. 14 2004 R335 R338
25. D.C. Knill, and A. Pouget The Bayesian brain: the role of uncertainty in neural coding and computation Trends Neurosci. 27 2004 712 719
26. D.C. Knill, and W. Richards Perception as Bayesian Inference 1996 Cambridge University Press New York
27. D.C. Knill, and J.A. Saunders Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Res. 43 2003 2539 2558
28. E.I. Knudsen Instructed learning in the auditory localization pathway of the barn owl Nature 417 2002 322 328
29. E.I. Knudsen, and M.S. Brainard Visual instruction of the neural map of auditory space in the developing optic tectum Science 253 1991 85 87
30. E.I. Knudsen, and P.F. Knudsen Vision calibrates sound localization in developing barn owls J. Neurosci. 9 1989 3306 3313
31. M.S. Landy, and H. Kojima Ideal cue combination for localizing texture-defined edges J. Opt. Soc. Am. A Opt. Image Sci. Vis. 18 2001 2307 2320
32. J. Lewald Rapid adaptation to auditory-visual spatial disparity Learn. Mem. 9 2002 268 278
33. S. Morein-Zamir, S. Soto-Faraco, and A. Kingstone Auditory capture of vision: examining temporal ventriloquism Brain Res. Cogn. Brain Res. 17 2003 154 163
34. J.R. Muller, M.G. Philiastides, and W.T. Newsome Microstimulation of the superior colliculus focuses attention without moving the eyes Proc. Natl. Acad. Sci. USA 102 2005 524 529
35. I. Oruc, L.T. Maloney, and M.S. Landy Weighted linear cue combination with possibly correlated error Vision Res. 43 2003 2451 2468
36. J.L. Pena, and M. Konishi Auditory spatial receptive fields created by multiplication Science 292 2001 249 252
37. T.J. Perrault Jr., J.W. Vaughan, B.E. Stein, and M.T. Wallace Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli J. Neurophysiol. 93 2005 2575 2586
38. L.C. Populin, and T.C. Yin Bimodal interactions in the superior colliculus of the behaving cat J. Neurosci. 22 2002 2826 2834
39. M. Radeau, and P. Bertelson The after-effects of ventriloquism Q. J. Exp. Psychol. 26 1974 63 71
40. M. Radeau, and P. Bertelson Auditory-visual interaction and the timing of inputs. Thomas (1941) revisited Psychol. Res. 49 1987 17 22
41. G.H. Recanzone Rapidly induced auditory plasticity: the ventriloquism aftereffect Proc. Natl. Acad. Sci. USA 95 1998 869 875
42. G.H. Recanzone Auditory influences on visual temporal rate perception J. Neurophysiol. 89 2003 1078 1093
43. J.A. Rice Mathematical Statistics and Data Analysis 1988 Wadsworth & Brooks/Cole Advanced Books & Software Pacific Grove, CA
44. L. Shams, Y. Kamitani, and S. Shimojo Visual illusion induced by sound Brain Res. Cogn. Brain Res. 14 2002 147 152
45. T.R. Stanford, S. Quessy, and B.E. Stein Evaluating the operations underlying multisensory integration in the cat superior colliculus J. Neurosci. 25 2005 6499 6508
46. B.E. Stein, and M.A. Meredith The Merging of the Senses 1993 MIT Press Cambridge, MA
47. B.E. Stein, W.S. Huneycutt, and M.A. Meredith Neurons and behavior: the same rules of multisensory integration apply Brain Res. 448 1988 355 358
48. M.T. Wallace, M.A. Meredith, and B.E. Stein Integration of multiple sensory modalities in cat cortex Exp. Brain Res. 91 1992 484 488
49. D.H. Warren, R.B. Welch, and T.J. McCarthy The role of visual-auditory "compellingness" in the ventriloquism effect: implications for transitivity among the spatial senses Percept. Psychophys. 30 1981 557 564
50. R.B. Welch, and D.H. Warren Immediate perceptual response to intersensory discrepancy Psychol. Bull. 88 1980 638 667
51. T.M. Woods, and G.H. Recanzone Visually induced plasticity of auditory spatial perception in macaques Curr. Biol. 14 2004 1559 1564
52. R.S. Zemel, P. Dayan, and A. Pouget Probabilistic interpretation of population codes Neural Comput. 10 1998 403 430