The role of stereo vision in visual-vestibular integration

Seeing and Perceiving

Volumn 24, Issue 5, 2011, Pages 453-470

  Butler, John S ^a,b   Campos, Jennifer L ^a,c,d,e   Bülthoff, Heinrich H ^a,f   Smith, Stuart T ^g  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^c TORONTO REHABILITATION INSTITUTE   (Canada)

^d UNIVERSITY OF TORONTO   (Canada)

^e YORK UNIVERSITY   (Canada)

^f Korea University   (South Korea)

^g NEUROSCIENCE RESEARCH AUSTRALIA   (Australia)

Author keywords

Maximum likelihood estimation; Multi sensory integration; Self motion perception; Stereo vision; Vestibular

Indexed keywords

BINOCULAR INFORMATION; CUE INTEGRATION; GROUP LEVEL; MULTI-SENSORY INTEGRATION; OPTIC FLOW; OPTIMAL INTEGRATION; SELF MOTION; SELF-MOTION PERCEPTION; SENSORY SYSTEM; VESTIBULAR; VESTIBULAR CUES; VESTIBULAR SYSTEM; VISUAL CUES; VISUAL STIMULUS; VISUAL SYSTEMS;

BINOCULARS; ESTIMATION; INTEGRATION; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION;

STEREO VISION;

ADULT; ARTICLE; ASSOCIATION; BINOCULAR VISION; DEPTH PERCEPTION; HUMAN; MALE; MOVEMENT PERCEPTION; PHYSIOLOGY; STATISTICAL MODEL; VESTIBULE; VESTIBULOOCULAR REFLEX;

ADULT; CUES; DEPTH PERCEPTION; HUMANS; LIKELIHOOD FUNCTIONS; MALE; MOTION PERCEPTION; REFLEX, VESTIBULO-OCULAR; VESTIBULE, LABYRINTH; VISION, BINOCULAR; YOUNG ADULT;

EID: 80053390011     PISSN: 18784755     EISSN: 18784763     Source Type: Journal    
DOI: 10.1163/187847511X588070     Document Type: Article

References (44)

1. Alais, D. and Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration, Curr. Biol. 14, 257-262. (Pubitemid 38215356)
2. Benson, A. J., Spencer, M. B. and Stott, J. R. (1986). Thresholds for the detection of the direction of whole-body, linear movement in the horizontal plane, Aviat. Space Environ. Med. 57, 1088-1096. (Pubitemid 17206953)
3. Bentvelzen, A., Leung, J. and Alais, D. (2009). Discriminating audiovisual speed: optimal integration of speed defaults to probability summation when component reliabilities diverge, Perception 38, 966-987.
4. Bremmer, F., Duhamel, J. R., Ben Hamed, S. and Graf,W. (2002a). Heading encoding in the macaque ventral intraparietal area (VIP), Eur. J. Neurosci. 16, 1554-1568. (Pubitemid 35334993)
5. Bremmer, F., Klam, F., Duhamel, J. R., Ben Hamed, S. and Graf, W. (2002b). Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP), Eur. J. Neurosci. 16, 1569-1586. (Pubitemid 35334994)
6. Britten, K. H. and Van Wezel, R. J. (1998). Electrical microstimulation of cortical area MST biases heading perception in monkeys, Nat. Neurosci. 1, 59-63. (Pubitemid 128652643)
7. Britten, K. H. and Van Wezel, R. J. (2002). Area MST and heading perception in macaque monkeys, Cerebral Cortex 12, 692-701. (Pubitemid 34680533)
8. Bülthoff, H. H. and Yuille, A. (1991). Bayesian models for seeing shapes and depth, Comm. Theoret. Biol. 2, 283-314.
9. Butler, J. S., Smith, S. T., Campos, J. L. and Bülthoff, H. H. (2010). Bayesian integration of visual and vestibular signals for heading, J. Vision 10, 23.
10. de Winkel, K. N., Weesie, J., Werkhoven, P. J. and Groen, E. L. (2010). Integration of visual and inertial cues in perceived heading of self-motion, J. Vision 10, 1.
11. Duffy, C. J. andWurtz, R. H. (1991). Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli, J. Neurophysiol. 65, 1329-1345.
12. Ernst, M. O. and Banks,M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion, Nature 415, 429-433. (Pubitemid 34100953)
13. Ernst, M. O. and Bülthoff, H. H. (2004). Merging the senses into a robust percept, Trends Cognit. Sci. 8, 162-169. (Pubitemid 38429926)
14. Ernst, M. O., Banks, M. S. and Bülthoff, H. H. (2000). Touch can change visual slant perception, Nat. Neurosci. 3, 69-73. (Pubitemid 30126350)
15. Fetsch, C. R., Turner, A. H., DeAngelis, G. C. and Angelaki, D. E. (2009). Dynamic reweighting of visual and vestibular cues during self-motion perception, J. Neurosci. 29, 15601-15612.
16. Frenz, H. and Lappe, M. (2005). Absolute travel distance from optic flow, Vision Research 45, 1679-1692. (Pubitemid 40403828)
17. Frenz, H. and Lappe, M. (2006). Visual distance estimation in static compared to moving virtual scenes, Spanish J. Psychol. 9, 321-331. (Pubitemid 44861041)
18. Gu, Y., DeAngelis, G. C. and Angelaki, D. E. (2007). A functional link between area MSTd and heading perception based on vestibular signals, Nat. Neurosci. 10, 1038-1047. (Pubitemid 47185203)
19. Gu, Y., Angelaki, D. E. and DeAngelis, G. C. (2008). Neural correlates of multisensory cue integration in macaque MSTd, Nat. Neurosci. 11, 1201-1210.
20. Gu, Y., Fetsch, C. R., Adeyemo, B., Deangelis, G. C. and Angelaki, D. E. (2010). Decoding of MSTd population activity accounts for variations in the precision of heading perception, Neuron 66, 596-609.
21. Heuer, H. W. and Britten, K. H. (2004). Optic flow signals in extrastriate area MST: comparison of perceptual and neuronal sensitivity, J. Neurophysiol. 91, 1314-1326. (Pubitemid 38250413)
22. Kording, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B. and Shams, L. (2007). Causal inference in multisensory perception, PLoS One 2, e943.
23. Lappe, M., Bremmer, F. and Van Den Berg, A. V. (1999). Perception of self-motion from visual flow, Trends Cognit. Sci. 3, 329-336. (Pubitemid 29417564)
24. MacNeilage, P. R., Banks, M. S., Berger, D. R. and Bülthoff, H. H. (2007). A Bayesian model of the disambiguation of gravitoinertial force by visual cues, Exper. Brain Res. 179, 263-290. (Pubitemid 46676151)
25. Ohmi,M. (1996). Egocentric perception through interaction among many sensory systems, Brain Res. Cognit. Brain Res. 5, 87-96. (Pubitemid 27095240)
26. Page, W. K. and Duffy, C. J. (2003). Heading representation in MST: sensory interactions and population encoding, J. Neurophysiol. 89, 1994-2013. (Pubitemid 36444254)
27. Palmisano, S. (1996). Perceiving self-motion in depth: the role of stereoscopic motion and changingsize cues, Percept. Psychophys. 58, 1168-1176. (Pubitemid 126421186)
28. Perrone, J. A. and Stone, L. S. (1998). Emulating the visual receptive-field properties of MST neurons with a template model of heading estimation, J. Neurosci. 18, 5958-5975. (Pubitemid 28341371)
29. Roy, J. P. and Wurtz, R. H. (1990). The role of disparity-sensitive cortical neurons in signalling the direction of self-motion, Nature 348, 160-162.
30. Roy, J. P., Komatsu, H. andWurtz, R. H. (1992). Disparity sensitivity of neurons in monkey extrastriate area MST, J. Neurosci. 12, 2478-2492.
31. Royden, C. S., Banks, M. S. and Crowell, J. A. (1992). The perception of heading during eye movements, Nature 360, 583-585. (Pubitemid 23000706)
32. Sato, Y., Toyoizumi, T. and Aihara, K. (2007). Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli, Neural Comput. 19, 3335-3355.
33. Taylor, J. R. (1997). An Introduction to Error Analysis: The Study of Uncertainties in Physical Measurements. University Science Books, Sausalito, CA, USA.
34. Telford, L., Howard, I. P. and Ohmi, M. (1995). Heading judgments during active and passive selfmotion, Exper. Brain Res. 104, 502-510.
35. Upadhyay, U. D., Page, W. K. and Duffy, C. J. (2000). MST responses to pursuit across optic flow with motion parallax, J. Neurophysiol. 84, 818-826. (Pubitemid 30655604)
36. van den Berg, A. V. and Brenner, E. (1994). Why two eyes are better than one for judgements of heading, Nature 371, 700-702. (Pubitemid 24327328)
37. von der Heyde, M. (2001). A Distributed Virtual Reality System for Spatial Updating: Concepts, Implementation, and Experiments. Universität Bielefeld, Germany.
38. Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W. and Schirillo, J. A. (2004). Unifying multisensory signals across time and space, Exper. Brain Res. 158, 252-258. (Pubitemid 39281121)
39. Warren, W. H., Jr. and Hannon, D. J. (1990). Eye movements and optical flow, J. Optic. Soc. Amer. A 7, 160-169.
40. Warren, P. A. and Rushton, S. K. (2009). Perception of scene-relative object movement: optic flow parsing and the contribution of monocular depth cues, Vision Research 49, 1406-1419.
41. Werner, S. and Noppeney, U. (2010). Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization, Cereb. Cortex 20, 1829-1842.
42. Wichmann, F. A. and Hill, N. J. (2001a). The psychometric function: I. Fitting, sampling, and goodness of fit, Percept. Psychophys. 63, 1293-1313. (Pubitemid 33610257)
43. Wichmann, F. A. and Hill, N. J. (2001b). The psychometric function: II. Bootstrap-based confidence intervals and sampling, Percept. Psychophys. 63, 1314-1329. (Pubitemid 33610258)
44. Yuille, A. and Bülthoff, H. H. (1996). Bayesian decision theory and psychophysics, in:Perception as Bayesian Inference , D. Knill andW. Richards (Eds). Cambridge University Press, Cambridge, UK.