Multisensory integration: Resolving sensory ambiguities to build novel representations

Current Opinion in Neurobiology

Volumn 20, Issue 3, 2010, Pages 353-360

  Green, Andrea M ^a   Angelaki, Dora E ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMBIGUITY; HUMAN; MOTION; NERVE CELL; NERVOUS SYSTEM; NEUROBIOLOGY; NEUROPHYSIOLOGY; NONHUMAN; OTOLITH; PRIORITY JOURNAL; PROPRIOCEPTION; PURKINJE CELL; REVIEW; SENSORIMOTOR INTEGRATION; SIGNAL PROCESSING; VESTIBULAR SYSTEM; VISUAL STIMULATION;

ANIMALS; HUMANS; MODELS, NEUROLOGICAL; MOTION PERCEPTION; ORIENTATION; POSTURAL BALANCE; PSYCHOMOTOR PERFORMANCE; SELF CONCEPT;

EID: 77954760265     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2010.04.009     Document Type: Review

References (50)

1. Stein B.E., Stanford T.R. Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 2008, 9:255-266.
2. Driver J., Noesselt T. Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 2008, 57:11-23.
3. Bulkin D.A., Groh J.M. Seeing sounds: visual and auditory interactions in the brain. Curr Opin Neurobiol 2006, 16:415-419.
4. Angelaki D.E., Gu Y., Deangelis G.C. Multisensory integration: psychophysics, neurophysiology, and computation. Curr Opin Neurobiol 2009.
5. Bayesian decision theory and psychophysics 1996, Cambridge University Press, New York. A.L. Yuille, H.H. Bülthoff (Eds.).
6. Bayesian modeling of visual perception 2002, MIT Press, Cambridge, MA. P. Mamassian, M.S. Landy, L.T. Maloney (Eds.).
7. Knill D.C., Pouget A. The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci 2004, 27:712-719.
8. Fetsch C.R., Turner A.H., DeAngelis G.C., Angelaki D.E. Dynamic reweighting of visual and vestibular cues during self-motion perception. J Neurosci 2009, 29:15601-15612.
9. Gu Y., Angelaki D.E., Deangelis G.C. Neural correlates of multisensory cue integration in macaque MSTd. Nat Neurosci 2008, 11:1201-1210.
10. Angelaki D.E., Shaikh A.G., Green A.M., Dickman J.D. Neurons compute internal models of the physical laws of motion. Nature 2004, 430:560-564.
11. Fernandez C., Goldberg J.M. Physiology of peripheral neurons innervating otolith organs of the squirrel monkey. I. Response to static tilts and to long-duration centrifugal force. J Neurophysiol 1976, 39:970-984.
12. Fernandez C., Goldberg J.M. Physiology of peripheral neurons innervating otolith organs of the squirrel monkey. III. Response dynamics. J Neurophysiol 1976, 39:996-1008.
13. Angelaki D.E., McHenry M.Q., Dickman J.D., Newlands S.D., Hess B.J. Computation of inertial motion: neural strategies to resolve ambiguous otolith information. J Neurosci 1999, 19:316-327.
14. Green A.M., Angelaki D.E. Resolution of sensory ambiguities for gaze stabilization requires a second neural integrator. J Neurosci 2003, 23:9265-9275.
15. Merfeld D.M., Park S., Gianna-Poulin C., Black F.O., Wood S. Vestibular perception and action employ qualitatively different mechanisms. II. VOR and perceptual responses during combined Tilt & Translation. J Neurophysiol 2005, 94:199-205.
16. Merfeld D.M., Zupan L., Peterka R.J. Humans use internal models to estimate gravity and linear acceleration. Nature 1999, 398:615-618.
17. MacNeilage P.R., Banks M.S., Berger D.R., Bulthoff H.H. A Bayesian model of the disambiguation of gravitoinertial force by visual cues. Exp Brain Res 2007, 179:263-290.
18. Zupan L.H., Merfeld D.M. Neural processing of gravito-inertial cues in humans. IV. Influence of visual rotational cues during roll optokinetic stimuli. J Neurophysiol 2003, 89:390-400.
19. Yakusheva T.A., Shaikh A.G., Green A.M., Blazquez P.M., Dickman J.D., Angelaki D.E. Purkinje cells in posterior cerebellar vermis encode motion in an inertial reference frame. Neuron 2007, 54:973-985.
20. Green A.M., Shaikh A.G., Angelaki D.E. Sensory vestibular contributions to constructing internal models of self-motion. J Neural Eng 2005, 2:S164-S179.
21. Shaikh A.G., Green A.M., Ghasia F.F., Newlands S.D., Dickman J.D., Angelaki D.E. Sensory convergence solves a motion ambiguity problem. Curr Biol 2005, 15:1657-1662.
22. Green A.M., Angelaki D.E. An integrative neural network for detecting inertial motion and head orientation. J Neurophysiol 2004, 92:905-925.
23. Green A.M., Angelaki D.E. Coordinate transformations and sensory integration in the detection of spatial orientation and self-motion: from models to experiments. Prog Brain Res 2007, 165:155-180.
24. von Helmholtz H. Handbuch der Physiologischen Optik [Treatise on Physiological Optics] 1925, Opt. Soc. Am, Rochester. J.P.C. Southall (Ed.).
25. von Holst E., Mittelstaedt H. Das reafferenzprinzip. Naturwissenschaften 1950, 37:464-476.
26. Cullen K.E., Minor L.B. Semicircular canal afferents similarly encode active and passive head-on-body rotations: implications for the role of vestibular efference. J Neurosci 2002, 22:RC226.
27. Jamali M., Sadeghi S.G., Cullen K.E. Response of vestibular nerve afferents innervating utricle and saccule during passive and active translations. J Neurophysiol 2009, 101:141-149.
28. McCrea R.A., Gdowski G.T., Boyle R., Belton T. Firing behavior of vestibular neurons during active and passive head movements: vestibulo-spinal and other non-eye-movement related neurons. J Neurophysiol 1999, 82:416-428.
29. Roy J.E., Cullen K.E. Selective processing of vestibular reafference during self-generated head motion. J Neurosci 2001, 21:2131-2142.
30. Roy J.E., Cullen K.E. Dissociating self-generated from passively applied head motion: neural mechanisms in the vestibular nuclei. J Neurosci 2004, 24:2102-2111.
31. Gibson J.J. The Perception of the Visual World 1950, Houghton Mifflin, Boston.
32. Optic Flow 2003, MIT Press, Cambridge, MA. W.H. Warren (Ed.).
33. Banks M.S., Ehrlich S.M., Backus B.T., Crowell J.A. Estimating heading during real and simulated eye movements. Vision Res 1996, 36:431-443.
34. Royden C.S., Banks M.S., Crowell J.A. The perception of heading during eye movements. Nature 1992, 360:583-585.
35. Warren W.H., Hannon D.J. Eye movements and optical flow. J Opt Soc Am A 1990, 7:160-169.
36. Britten K.H. Mechanisms of self-motion perception. Annu Rev Neurosci 2008, 31:389-410.
37. Inaba N., Shinomoto S., Yamane S., Takemura A., Kawano K. MST neurons code for visual motion in space independent of pursuit eye movements. J Neurophysiol 2007, 97:3473-3483.
38. Chukoskie L., Movshon J.A. Modulation of visual signals in macaque MT and MST neurons during pursuit eye movement. J Neurophysiol 2009, 102:3225-3233.
39. Bradley D.C., Maxwell M., Andersen R.A., Banks M.S., Shenoy K.V. Mechanisms of heading perception in primate visual cortex. Science 1996, 273:1544-1547.
40. Page W.K., Duffy C.J. MST neuronal responses to heading direction during pursuit eye movements. J Neurophysiol 1999, 81:596-610.
41. Shenoy K.V., Bradley D.C., Andersen R.A. Influence of gaze rotation on the visual response of primate MSTd neurons. J Neurophysiol 1999, 81:2764-2786.
42. Shenoy K.V., Crowell J.A., Andersen R.A. Pursuit speed compensation in cortical area MSTd. J Neurophysiol 2002, 88:2630-2647.
43. Lee B., Pesaran B., Andersen R.A. Translation speed compensation in the dorsal aspect of the medial superior temporal area. J Neurosci 2007, 27:2582-2591.
44. Zhang T., Heuer H.W., Britten K.H. Parietal area VIP neuronal responses to heading stimuli are encoded in head-centered coordinates. Neuron 2004, 42:993-1001.
45. Brooks J.X., Cullen K.E. Multimodal integration in rostral fastigial nucleus provides an estimate of body movement. J. Neurosci 2009, 29:10499-10511.
46. Kleine J.F., Guan Y., Kipiani E., Glonti L., Hoshi M., Buttner U. Trunk position influences vestibular responses of fastigial nucleus neurons in the alert monkey. J Neurophysiol 2004, 91:2090-2100.
47. Shaikh A.G., Meng H., Angelaki D.E. Multiple reference frames for motion in the primate cerebellum. J Neurosci 2004, 24:4491-4497.
48. Ilg U.J., Schumann S., Thier P. Posterior parietal cortex neurons encode target motion in world-centered coordinates. Neuron 2004, 43:145-151.
49. Fetsch C.R., Wang S., Gu Y., Deangelis G.C., Angelaki D.E. Spatial reference frames of visual, vestibular, and multimodal heading signals in the dorsal subdivision of the medial superior temporal area. J Neurosci 2007, 27:700-712.
50. Angelaki D.E., Yakusheva T.A., Green A.M., Dickman J.D., Blazquez P.M. Computation of egomotion in the macaque cerebellar vermis. Cerebellum 2009.