Models and processes of multisensory cue combination

Current Opinion in Neurobiology

Volumn 25, Issue , 2014, Pages 38-46

  Seilheimer, Robert L ^a   Rosenberg, Ari ^a   Angelaki, Dora E ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR; BRAIN FUNCTION; CONCEPTUAL FRAMEWORK; HUMAN; MENTAL FUNCTION; MULTISENSORY CUE COMBINATION; NERVE CELL; NONHUMAN; PRIORITY JOURNAL; REVIEW; SENSORY STIMULATION; SENSORY SYSTEM; STATISTICAL MODEL; ANIMAL; ASSOCIATION; BIOLOGICAL MODEL; BRAIN; PHYSIOLOGY; SENSATION;

ANIMALS; BRAIN; CUES; HUMANS; MODELS, NEUROLOGICAL; NEURONS; SENSATION;

EID: 84890602831     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2013.11.008     Document Type: Review

References (62)

1. Knill D.C., Richards W. Perception as Bayesian inference 1996, Cambridge University Press, Cambridge.
2. Ernst M.O., Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 2002, 415:429-433.
3. Alais D., Burr D. The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 2004, 14:257-262.
4. Fetsch C.R., Pouget A., DeAngelis G.C., Angelaki D.E. Neural correlates of reliability-based cue weighting during multisensory integration. Nat Neurosci 2011, 15:146-154.
5. Raposo D., Sheppard J.P., Schrater P.R., Churchland A.K. Multisensory decision-making in rats and humans. J Neurosci 2012, 32:3726-3735.
6. Sheppard J.P., Raposo D., Churchland A.K. Dynamic weighting of multisensory stimuli shapes decision-making in rats and humans. J Vis 2013, 13.
7. Laurens J., Angelaki D.E. The functional significance of velocity storage and its dependence on gravity. Exp Brain Res 2011, 210:407-422.
8. Laurens J., Meng H., Angelaki D.E. Computation of linear acceleration through an internal model in the macaque cerebellum. Nat Neurosci 2013, 16:1701-1708.
9. Laurens J., Meng H., Angelaki D.E. Neural representation of gravity in the macaque vestibulocerebellum. Neuron 2013, (in press). 10.1016/j.neuron.2013.09.029.
10. Ma W.J. Organizing probabilistic models of perception. Trends Cogn Sci 2012, 16:511-518.
11. Gu Y., Angelaki D.E., DeAngelis G.C. Neural correlates of multisensory cue integration in macaque MSTd. Nat Neurosci 2008, 11:1201-1210.
12. Kording K.P., Beierholm U., Ma W.J., Quartz S., Tenenbaum J.B., Shams L. Causal inference in multisensory perception. PLoS ONE 2007, 2:e943.
13. Shams L., Beierholm U.R. Causal inference in perception. Trends Cogn Sci 2010, 14:425-432.
14. Ma W.J., Beck J.M., Latham P.E., Pouget A. Bayesian inference with probabilistic population codes. Nat Neurosci 2006, 9:1432-1438.
15. Zemel R.S., Dayan P., Pouget A. Probabilistic interpretation of population codes. Neural Comput 1998, 10:403-430.
16. Zohary E., Shadlen M.N., Newsome W.T. Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 1994, 370:140-143.
17. Gu Y., Liu S., Fetsch C.R., Yang Y., Fok S., Sunkara A., DeAngelis G.C., Angelaki D.E. Perceptual learning reduces interneuronal correlations in macaque visual cortex. Neuron 2011, 71:750-761.
18. Gur M., Snodderly D.M. High response reliability of neurons in primary visual cortex (V1) of alert, trained monkeys. Cereb Cortex 2006, 16:888-895.
19. Berens P., Ecker A.S., Cotton R.J., Ma W.J., Bethge M., Tolias A.S. A fast and simple population code for orientation in primate V1. J Neurosci 2012, 32:10618-10626.
20. Graf A.B., Kohn A., Jazayeri M., Movshon J.A. Decoding the activity of neuronal populations in macaque primary visual cortex. Nat Neurosci 2011, 14:239-245.
21. Ohshiro T., Angelaki D.E., DeAngelis G.C. A normalization model of multisensory integration. Nat Neurosci 2011, 14:775-782.
22. Carandini M., Heeger D.J. Normalization as a canonical neural computation. Nat Rev Neurosci 2011, 13:51-62.
23. Louie K., Khaw M.W., Glimcher P.W. Normalization is a general neural mechanism for context-dependent decision making. Proc Natl Acad Sci U S A 2013, 110:6139-6144.
24. Morgan M.L., DeAngelis G.C., Angelaki D.E. Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 2008, 59:662-673.
25. Beck J.M., Latham P.E., Pouget A. Marginalization in neural circuits with divisive normalization. J Neurosci 2011, 31:15310-15319.
26. Mazyar H., van den Berg R., Seilheimer R.L., Ma W.J. Independence is elusive: set size effects on encoding precision in visual search. J Vis 2013, 13.
27. Avillac M., Deneve S., Olivier E., Pouget A., Duhamel J.R. Reference frames for representing visual and tactile locations in parietal cortex. Nat Neurosci 2005, 8:941-949.
28. Schlack A., Sterbing-D'Angelo S.J., Hartung K., Hoffmann K.P., Bremmer F. Multisensory space representations in the macaque ventral intraparietal area. J Neurosci 2005, 25:4616-4625.
29. Chen A., DeAngelis G.C., Angelaki D.E. Representation of vestibular and visual cues to self-motion in ventral intraparietal cortex. J Neurosci 2011, 31:12036-12052.
30. Chen A., DeAngelis G.C., Angelaki D.E. Functional specializations of the ventral intraparietal area for multisensory heading discrimination. J Neurosci 2013, 33:3567-3581.
31. Cohen Y.E., Andersen R.A. A common reference frame for movement plans in the posterior parietal cortex. Nat Rev Neurosci 2002, 3:553-562.
32. Chen X., DeAngelis G.C., Angelaki D.E. Diverse spatial reference frames of vestibular signals in parietal cortex. Neuron 2013, 80:1310-1321. (in press).
33. Chen X., DeAngelis G.C., Angelaki D.E. Eye-centered representation of optic flow tuning in the ventral intraparietal area. J Neurosci 2013, 33:18574-18582.
34. Fetsch C.R., Wang S., Gu Y., DeAngelis G.C., Angelaki D.E. Spatial reference frames of visual, vestibular, and multimodal heading signals in the dorsal subdivision of the medial superior temporal area. J Neurosci 2007, 27:700-712.
35. Deneve S., Latham P.E., Pouget A. Efficient computation and cue integration with noisy population codes. Nat Neurosci 2001, 4:826-831.
36. De Meyer K., Spratling M.W. A model of partial reference frame transforms through pooling of gain-modulated responses. Cereb Cortex 2013, 23:1230-1239.
37. Rosenberg A., Cowan N.J., Angelaki D.E. The visual representation of 3D object orientation in parietal cortex. J Neurosci 2013, 33:19352-19361.
38. Palmer J., Huk A.C., Shadlen M.N. The effect of stimulus strength on the speed and accuracy of a perceptual decision. J Vis 2005, 5:376-404.
39. Roitman J.D., Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci 2002, 22:9475-9489.
40. Kiani R., Shadlen M.N. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 2009, 324:759-764.
41. Churchland A.K., Kiani R., Chaudhuri R., Wang X.J., Pouget A., Shadlen M.N. Variance as a signature of neural computations during decision making. Neuron 2011, 69:818-831.
42. Beck J.M., Ma W.J., Kiani R., Hanks T., Churchland A.K., Roitman J., Shadlen M.N., Latham P.E., Pouget A. Probabilistic population codes for Bayesian decision making. Neuron 2008, 60:1142-1152.
43. Drugowitsch J., Pouget A. Probabilistic vs. non-probabilistic approaches to the neurobiology of perceptual decision-making. Curr Opin Neurobiol 2012, 22:963-969.
44. Gori M., Del Viva M., Sandini G., Burr D.C. Young children do not integrate visual and haptic form information. Curr Biol 2008, 18:694-698.
45. Gori M., Giuliana L., Sandini G., Burr D. Visual size perception and haptic calibration during development. Dev Sci 2012, 15:854-862.
46. Nardini M., Begus K., Mareschal D. Multisensory uncertainty reduction for hand localization in children and adults. J Exp Psychol Hum Percept Perform 2013, 39:773-787.
47. Gori M., Sandini G., Martinoli C., Burr D. Poor haptic orientation discrimination in nonsighted children may reflect disruption of cross-sensory calibration. Curr Biol 2010, 20:223-225.
48. Gori M., Tinelli F., Sandini G., Cioni G., Burr D. Impaired visual size-discrimination in children with movement disorders. Neuropsychologia 2012, 50:1838-1843.
49. Zaidel A., Ma W.J., Angelaki D.E. Supervised calibration relies on the multisensory percept. Neuron 2013, 10.1016/j.neuron.2013.09.026.
50. Zaidel A., Turner A.H., Angelaki D.E. Multisensory calibration is independent of cue reliability. J Neurosci 2011, 31:13949-13962.
51. Cohen L., Rothschild G., Mizrahi A. Multisensory integration of natural odors and sounds in the auditory cortex. Neuron 2011, 72:357-369.
52. Xu J., Yu L., Rowland B.A., Stanford T.R., Stein B.E. Incorporating cross-modal statistics in the development and maintenance of multisensory integration. J Neurosci 2012, 32:2287-2298.
53. Wallace M.T., Stein B.E. Early experience determines how the senses will interact. J Neurophysiol 2007, 97:921-926.
54. Weisswange T.H., Rothkopf C.A., Rodemann T., Triesch J. Bayesian cue integration as a developmental outcome of reward mediated learning. PLoS ONE 2011, 6:e21575.
55. Makin J.G., Fellows M.R., Sabes P.N. Learning multisensory integration and coordinate transformation via density estimation. PLoS Comput Biol 2013, 9:e1003035.
56. Stocker A.A., Simoncelli E.P. Noise characteristics and prior expectations in human visual speed perception. Nat Neurosci 2006, 9:578-585.
57. MacNeilage P.R., Banks M.S., Berger D.R., Bulthoff H.H. A Bayesian model of the disambiguation of gravitoinertial force by visual cues. Exp Brain Res 2007, 179:263-290.
58. De Vrijer M., Medendorp W.P., Van Gisbergen J.A. Shared computational mechanism for tilt compensation accounts for biased verticality percepts in motion and pattern vision. J Neurophysiol 2008, 99:915-930.
59. Kim R., Peters M.A., Shams L. 0+1>1: How adding noninformative sound improves performance on a visual task. Psychol Sci 2012, 23:6-12.
60. Hedger S.C., Nusbaum H.C., Lescop O., Wallisch P., Hoeckner B. Music can elicit a visual motion aftereffect. Atten Percept Psychophys 2013, 75:1039-1047.
61. van der Groen O., van der Burg E., Lunghi C., Alais D. Touch influences visual perception with a tight orientation-tuning. PLOS One 2013, 8:e79558.
62. Ma W.J., Rahmati M. Towards a neural implementation of causal inference in cue combination. Multisensory Res 2013, 26:159-176.