Dynamic reweighting of visual and vestibular cues during self-motion perception

Journal of Neuroscience

Volumn 29, Issue 49, 2009, Pages 15601-15612

  Fetsch, Christopher R ^a   Turner, Amanda H ^a   DeAngelis, Gregory C ^b   Angelaki, Dora E ^a  

^a WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; AUDITORY DISCRIMINATION; BAYES THEOREM; CONFLICT; CONTROLLED STUDY; DYNAMICS; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MONKEY; MOVEMENT PERCEPTION; NONHUMAN; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; PSYCHOPHYSICS; RELIABILITY; SELF CONCEPT; SYSTEM ANALYSIS; VESTIBULAR SYSTEM; VISUAL STIMULATION; VISUAL SYSTEM;

ALGORITHMS; ANIMALS; BAYES THEOREM; COMPUTER SIMULATION; CUES; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MACACA MULATTA; MALE; MODELS, NEUROLOGICAL; MOVEMENT; NEUROPSYCHOLOGICAL TESTS; PROPRIOCEPTION; PSYCHOMETRICS; PSYCHOPHYSICS; REINFORCEMENT SCHEDULE; VISION, BINOCULAR; VISUAL PERCEPTION;

EID: 71849088010     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2574-09.2009     Document Type: Article

References (68)

1. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14:257-262. (Pubitemid 38215356)
2. Battaglia PW, Jacobs RA, AslinRN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt SocAmA Opt Image Sci Vis 20:1391-1397.
3. Berthoz A, Pavard B, Young LR (1975) Perception of linear horizontal self-motion induced by peripheral vision (linearvection) basic characteristics and visual-vestibular interactions. Exp Brain Res 23:471-489.
4. Bertin RJ, Berthoz A (2004) Visuo-vestibular interaction in the reconstruction of travelled trajectories. Exp Brain Res 154:11-21.
5. Brandt T, Dichgans J, Koenig E (1972) Perception of self-rotation (circular vection) induced by optokinetic stimuli. Pflugers Arch 332 [Suppl 332]:R398.
6. Bremmer F, Duhamel JR, Ben Hamed S, GrafW (2002a) Heading encoding in the macaque ventral intraparietal area (VIP). Eur J Neurosci 16:1554-1568.
7. Bremmer F, Klam F, Duhamel JR, Ben Hamed S, Graf W (2002b) Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP). Eur J Neurosci 16:1569-1586. (Pubitemid 35334994)
8. Britten KH, van Wezel RJ (1998) Electrical microstimulation of cortical area MST biases heading perception in monkeys. Nat Neurosci 1:59-63.
9. Cheng K, Shettleworth SJ, Huttenlocher J, Rieser JJ (2007) Bayesian integration of spatial information. Psychol Bull 133:625-637.
10. Dayan P, Abbott LF (2001) Theoretical neuroscience. Cambridge, MA: MIT.
11. Deneve S, Pouget A (2004) Bayesian multisensory integration and crossmodal spatial links. J Physiol Paris 98:249-258. (Pubitemid 39345375)
12. Dichgans J, Brandt T (1978) Visual-vestibular interaction: effects on self-motion perception and postural control. In: Handbook of sensory physiology (Held R, Leibowitz HW, Teuber HL, eds), pp 756-804. Berlin: Springer.
13. Duffy CJ (1998) MST neurons respond to optic flow and translational movement. J Neurophysiol 80:1816-1827.
14. Duffy CJ, Wurtz RH (1991) Sensitivity of MST neurons to optic flow stimuli. II. Mechanisms of response selectivity revealed by small-field stimuli. J Neurophysiol 65:1346-1359.
15. Duffy CJ, Wurtz RH (1995) Response of monkey MST neurons to optic flow stimuli with shifted centers of motion. J Neurosci 15:5192-5208.
16. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433.
17. Foldiak P (1993) The "ideal homunculus": statistical inference from neural population responses. In: Computation and neural systems (Eeckman FH, Bower JM, eds), pp 55-60. Norwell, MA: Kluwer Academic Publishers.
18. Fukushima K (1997) Corticovestibular interactions: anatomy, electrophysiology, and functional considerations. Exp Brain Res 117:1-16.
19. Gibson JJ (1950) The perception of the visual world. Boston: Houghton-Mifflin.
20. Grüsser OJ, Pause M, Schreiter U (1990) Vestibular neurones in the parietoinsular cortex of monkeys (Macaca fascicularis): visual and neck receptor responses. J Physiol 430:559-583. (Pubitemid 20382840)
21. Gu Y, Watkins PV, Angelaki DE, DeAngelis GC (2006) Visual and nonvisual contributions to three-dimensional heading selectivity in the medial superior temporal area. J Neurosci 26:73-85. (Pubitemid 43089521)
22. Gu Y, DeAngelis GC, Angelaki DE (2007) A functional link between area MSTd and heading perception based on vestibular signals. Nat Neurosci 10:1038-1047. (Pubitemid 47185203)
23. Gu Y, Angelaki DE, Deangelis GC (2008) Neural correlates of multisensory cue integration in macaque MSTd. Nat Neurosci 11:1201-1210.
24. Guedry FE (1974) Psychophysics of vestibular sensation. In: Handbook of sensory physiology, The vestibular system (Kornhuber HH, ed). New York: Springer.
25. Harris LR, Jenkin M, Zikovitz DC (2000) Visual and non-visual cues in the perception of linear self-motion. Exp Brain Res 135:12-21. (Pubitemid 30800426)
26. Hillis JM, Watt SJ, Landy MS, Banks MS (2004) Slant from texture and disparity cues: optimal cue combination. J Vis 4:967-992.
27. Howard IP (1982) Human visual orientation. New York: Wiley.
28. Jacobs RA (1999) Optimal integration of texture and motion cues to depth. Vision Res 39:3621-3629. (Pubitemid 29347156)
29. Jazayeri M, Movshon JA (2006) Optimal representation of sensory information by neural populations. Nat Neurosci 9:690-696. (Pubitemid 44012268)
30. Jiang W, Jiang H, Stein BE (2002) Two corticotectal areas facilitate multisensory orientation behavior. J Cogn Neurosci 14:1240-1255. (Pubitemid 35305828)
31. Judge SJ, Richmond BJ, Chu FC (1980) Implantation of magnetic search coils for measurement of eye position: an improved method. Vision Res 20:535-538.
32. Knill DC (2007) Robust cue integration: a Bayesian model and evidence from cue-conflict studies with stereoscopic and figure cues to slant. J Vis 7:5 1-24.
33. Knill DC, Pouget A (2004) The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci 27:712-719.
34. Knill DC, Saunders JA (2003) Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Res 43:2539-2558.
35. Körding KP, Beierholm U,MaWJ, Quartz S, Tenenbaum JB, Shams L (2007) Causal inference in multisensory perception. PLoS ONE 2:e943.
36. Landy MS, Kojima H (2001) Ideal cue combination for localizing texture-defined edges. J Opt Soc Am A Opt Image Sci Vis 18:2307-2320.
37. Landy MS, Maloney LT, Johnston EB, Young M (1995) Measurement and modeling of depth cue combination: in defense of weak fusion. Vision Res 35:389-412.
38. Ma WJ, Beck JM, Latham PE, Pouget A (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9:1432-1438. (Pubitemid 44646216)
39. Mach E (1875) Grundlinien der Lehre von den Bewegungsempfindungen. Leipzig, Germany: Engelmann.
40. MacNeilage PR, Banks MS, Berger DR, Bülthoff HH (2007) A Bayesian model of the disambiguation of gravitoinertial force by visual cues. Exp Brain Res 179:263-290.
41. Morgan ML, Deangelis GC, Angelaki DE (2008) Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59:662-673.
42. Ohmi M (1996) Egocentric perception through interaction among many sensory systems. Brain Res Cogn Brain Res 5:87-96.
43. Oruç I, Maloney LT, Landy MS (2003) Weighted linear cue combination with possibly correlated error. Vision Res 43:2451-2468. (Pubitemid 38366046)
44. Pouget A, Dayan P, Zemel RS (2003) Inference and computation with population codes. Annu Rev Neurosci 26:381-410.
45. Roach NW, Heron J, McGraw PV (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Proc Biol Sci 273:2159-2168. (Pubitemid 44318305)
46. Rosas P, Wagemans J, Ernst MO, Wichmann FA (2005) Texture and haptic cues in slant discrimination: reliability-based cue weighting without statistically optimal cue combination. J Opt Soc Am A Opt Image Sci Vis 22:801-809.
47. Rowland B, Stanford T, Stein B (2007) A Bayesian model unifies multisensory spatial localization with the physiological properties of the superior colliculus. Exp Brain Res 180:153-161. (Pubitemid 46870495)
48. Sanger TD (1996) Probability density estimation for the interpretation of neural population codes. J Neurophysiol 76:2790-2793.
49. Sato Y, Toyoizumi T, Aihara K (2007) Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli. Neural Comput 19:3335-3355.
50. Schaafsma SJ, Duysens J (1996) Neurons in the ventral intraparietal area of awake macaque monkey closely resemble neurons in the dorsal part of the medial superior temporal area in their responses to optic flow patterns. J Neurophysiol 76:4056-4068. (Pubitemid 27009705)
51. Schwarz DW, Fredrickson JM (1971) Rhesus monkey vestibular cortex: a bimodal primary projection field. Science 172:280-281.
52. Seung HS, Sompolinsky H (1993) Simple models for reading neuronal population codes. Proc Natl Acad Sci U S A 90:10749-10753. (Pubitemid 2007644)
53. Shams L, Ma WJ, Beierholm U (2005) Sound-induced flash illusion as an optimal percept. Neuroreport 16:1923-1927. (Pubitemid 41653515)
54. Stein BE (1998) Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp Brain Res 123:124-135.
55. Stein BE, Meredith MA (1993) The merging of the senses. Cambridge, MA: MIT.
56. Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9:255-266.
57. Stein BE, Huneycutt WS, Meredith MA (1988) Neurons and behavior: the same rules of multisensory integration apply. Brain Res 448:355-358.
58. Stein BE, Meredith MA, Huneycutt WS, McDade L (1989) Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J Cogn Neurosci 1:12-24.
59. Tanaka K, Saito H (1989) Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. J Neurophysiol 62:626-641. (Pubitemid 19236118)
60. Tanaka K, Hikosaka K, Saito H, Yukie M, Fukada Y, Iwai E (1986) Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. J Neurosci 6:134-144. (Pubitemid 16149227)
61. Telford L, Howard IP, Ohmi M (1995) Heading judgments during active and passive self-motion. Exp Brain Res 104:502-510.
62. van Beers RJ, Sittig AC, Gon JJ (1999) Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81:1355-1364.
63. van Beers RJ, Wolpert DM, Haggard P (2002) When feeling is more important than seeing in sensorimotor adaptation. Curr Biol 12:834-837.
64. Wallace MT, Meredith MA, Stein BE (1998) Multisensory integration in the superior colliculus of the alert cat. J Neurophysiol 80:1006-1010. (Pubitemid 28387680)
65. Wallace MT, Roberson GE, Hairston WD, Stein BE, Vaughan JW, Schirillo JA (2004) Unifying multisensory signals across time and space. Exp Brain Res 158:252-258. (Pubitemid 39281121)
66. Warren WH (2003) Optic flow. In: The visual neurosciences (Chalupa LM, Werner JS, eds), pp 1247-1259. Cambridge, MA: MIT.
67. Wichmann FA, Hill NJ (2001a) The psychometric function. I. Fitting, sampling, and goodness of fit. Percept Psychophys 63:1293-1313.
68. Wichmann FA, Hill NJ (2001b) The psychometric function. II. Bootstrap-based confidence intervals and sampling. Percept Psychophys 63:1314-1329.