Fusion of visual and auditory stimuli during saccades: A bayesian explanation for perisaccadic distortions

Journal of Neuroscience

Volumn 27, Issue 32, 2007, Pages 8525-8532

  Binda, Paola ^a,b   Bruno, Aurelio ^a,c   Burr, David C ^d,e   Morrone, Maria C ^a,f  

^a VITA SALUTE SAN RAFFAELE UNIVERSITY   (Italy)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d UNIVERSITY OF FLORENCE   (Italy)

^e UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^f Istituto Nazionale di Neuroscienze   (Italy)

Author keywords

Audition; Bayesian analysis; Cross modal fusion; Psychophysics; Saccades; Vision

Indexed keywords

ARTICLE; AUDITORY STIMULATION; AUDITORY THRESHOLD; BAYES THEOREM; DEPTH PERCEPTION; DIRECTIONAL HEARING; EYE FIXATION; EYE POSITION; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; SACCADIC EYE MOVEMENT; SIMULATION; TASK PERFORMANCE; VISION; VISUAL ORIENTATION; VISUAL STIMULATION; VISUAL THRESHOLD;

ACOUSTIC STIMULATION; BAYES THEOREM; HUMANS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SACCADES; VISUAL PERCEPTION;

EID: 34547881511     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0737-07.2007     Document Type: Article

References (39)

1. Alais D, Burr CD (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14:257-262.
2. Bahcall DO, Kowler E (1999) Illusory shifts in visual direction accompany adaptation of saccadic eye movements. Nature 400:864-866.
3. Batista AP, Buneo CA, Snyder LH, Andersen RA (1999) Reach plans in eyecentered coordinates. Science 285:257-260.
4. Bayes T (1764) An essay toward solving a problem in the Doctrine of Chances. Proc R Soc Lond B Biol Sci 370-418.
5. Bockisch CJ, Miller JM (1999) Different motor systems use similar damped extraretinal eye position information. Vision Res 39:1025-1038.
6. Burr DC, Morrone MC, Ross J (1994) Selective suppression of the magnocellular visual pathway during saccadic eye movements. Nature 371:511-513.
7. Clark JJ, Yuille AL (1990) Data fusion for sensory information processing systems. Boston: Kluwer.
8. Dassonville P, Schlag J, Schlag-Rey M (1992) Oculomotor localization relies on a damped representation of saccadic eye displacement in human and nonhuman primates. Vis Neurosci 9:261-269.
9. Deneve S, Latham PE, Pouget A (2001) Efficient computation and cue integration with noisy population codes. Nat Neurosci 4:826-831.
10. Duhamel JR, Colby CL, Goldberg ME (1992) The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255:90-92.
11. Ernst M, Banks M (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433.
12. Ernst M, Bulthoff H (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162-169.
13. Harris LR, Lieberman L (1996) Auditory stimulus detection is not suppressed during saccadic eye movements. Perception 25:999-1004.
14. Honda H (1989) Perceptual localization of visual stimuli flashed during saccades. Percept Psychophys 162-174.
15. Jazayeri M, Movshon JA (2006) Optimal representation of sensory information by neural populations. Nat Neurosci 9:690-696.
16. Klingenhoefer S, Bremmer F (2004) Perisaccadic mislocalization of auditory targets. Paper presented at Fifth Annual Meeting of the International Multisensory Research Forum, Barcelona, Spain, June.
17. Knill DC, Kersten D (1991) Apparent surface curvature affects lightness perception. Nature 351:228-230.
18. Kowler E, Anderson E, Dosher B, Blaser E (1995) The role of attention in the programming of saccades. Vision Res 35:1897-1916.
19. Kusunoki M, Goldberg ME (2003) The time course of perisaccadic receptive field shifts in the lateral intraparietal area of the monkey. J Neurophysiol 89:1519-1527.
20. Kusunoki M, Colby CL, Duhamel J-R, Goldberg ME (1997) The role of the lateral intraparietal area in the control of visuospatial attention. In: The association cortex: structure and function (Fuster JM, ed), pp 191-206. New York: Academic.
21. Lee DK, Itti L, Koch C, Braun J (1999) Attention activates winner-take-all competition among visual filters. Nat Neurosci 2:375-381.
22. Mateeff S (1978) Saccadic eye movements and localization of visual stimuli. Percept Psychophys 24:215-224.
23. Matin L (1972) Visual psychophysics. In: Handbook of sensory physiology (Jameson D, Hurvich LM, eds), pp 311-380. Berlin: Springer.
24. Matin L, Pearce DG (1965) Visual perception of direction for stimuli flashed during voluntary saccadic eye movements. Science 1485-1488.
25. Miller JM (1996) Egocentric localization of a perisaccadic flash by manual pointing. Vision Res 36:837-851.
26. Morrone MC, Ross J, Burr DC (1997) Apparent position of visual targets during real and simulated saccadic eye movements. J Neurosci 17:7941-7953.
27. Morrone MC, Denti V, Spinelli D (2002) Color and luminance contrasts attract independent attention. Curr Biol 12:1134-1137.
28. Nakamura K, Colby CL (2000) Visual, saccade-related, and cognitive activation of single neurons in monkey extrastriate area V3A. J Neurophysiol 84:677-692.
29. Niemeier M, Crawford JD, Tweed DB (2003) Optimal transsaccadic integration explains distorted spatial perception. Nature 422:76-80.
30. Pola J (2004) Models of the mechanism underlying perceived location of a perisaccadic flash. Vision Res 44:2799-2813.
31. Robinson DA (1975) Oculomotor control signals. In: Basic mechanisms of ocular motility and their clinical implications (Bach-y-Rita P, ed), pp 337-374. Oxford: Pergamon.
32. Ross J, Morrone MC, Burr DC (1997) Compression of visual space before saccades. Nature 386:598-601.
33. Sommer MA, Wurtz RH (2006) Influence of the thalamus on spatial visual processing in frontal cortex. Nature 444:374-377.
34. Umeno MM, Goldberg ME (1997) Spatial processing in the monkey frontal eye field. I. Predictive visual responses. J Neurophysiol 78:1373-1383.
35. Vliegen J, Van Grootel TJ, Van Opstal AJ (2004) Dynamic sound localization during rapid eye-head gaze shifts. J Neurosci 24:9291-9302.
36. Walker MF, Fitzgibbon EJ, Goldberg ME (1995) Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. J Neurophysiol 73:1988-2003.
37. Watson AB, Pelli DG (1983) Quest: a bayesian adaptive psychometric method. Percept Psychophys 113-120.
38. Weiss Y, Simoncelli EP, Adelson EH (2002) Motion illusions as optimal percepts. Nat Neurosci 5:598-604.
39. Witten IB, Knudsen EI (2005) Why seeing is believing: merging auditory and visual worlds. Neuron 48:489-496.