Neural coding of uncertainty and probability

Annual Review of Neuroscience

Volumn 37, Issue , 2014, Pages 205-220

  Ma, Wei Ji ^a   Jazayeri, Mehrdad ^b  

^a NEW YORK UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Bayesian inference; Decision making; Perception; Population encoding

Indexed keywords

ANTICIPATION; BAYES THEOREM; BEHAVIOR; BRAIN FUNCTION; COGNITION; DECISION MAKING; HUMAN; NONHUMAN; PERCEPTION; PLANNING; PRIORITY JOURNAL; PROBABILITY; PSYCHOLOGICAL THEORY; REVIEW; REWARD; THINKING; UNCERTAINTY; ANIMAL; BIOLOGICAL MODEL; BRAIN; NERVE CELL; PHYSIOLOGY;

ANIMALS; BAYES THEOREM; BRAIN; DECISION MAKING; HUMANS; MODELS, NEUROLOGICAL; NEURONS; PROBABILITY; UNCERTAINTY;

EID: 84904619218     PISSN: 0147006X     EISSN: 15454126     Source Type: Book Series    
DOI: 10.1146/annurev-neuro-071013-014017     Document Type: Review

References (125)

1. Acerbi L, Vijayakumar S, WolpertDM. 2014.Onthe origins of suboptimality in human probabilistic inference. PLOS Comp. Biol. In press
2. Acerbi L, Wolpert DM, Vijayakumar S. 2012. Internal representations of temporal statistics and feedback calibrate motor-sensory interval timing. PLoS Comput. Biol. 8(11):e1002771
3. Ahrens M, Sahani M. 2011. Observers exploit stochastic models of sensory change to help judge the passage of time. Curr. Biol. 21:1-7
4. Anastasio TJ, Patton PE, Belkacem-Boussaid K. 2000. Using Bayes rule to modelmultisensory enhancement in the superior colliculus. Neural Comput. 12(5):1165-87
5. Anderson C. 1994. Neurobiological computational systems. In Computational Intelligence Imitating Life, pp. 213-22. New York: IEEE Press
6. Barber MJ,Clark JW, Anderson CH. 2003. Neural representation of probabilistic information. Neural Comput. 15(8):1843-64
7. Barlow HB, Levick WR. 1969. Three factors limiting the reliable detection of light by retinal ganglion cells of the cat. J. Physiol. 200:1-24
8. Barraclough DJ, Conroy ML, et al. 2004. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7:404-10
9. Barthelme S, Mamassian P. 2009. Evaluation of objective uncertainty in the visual system. PLoS Comput. Biol. 5(9):e1000504
10. Basso MA,Wurtz RH. 1997. Modulation of neuronal activity by target uncertainty. Nature 389:66-69
11. Battaglia PW, Hamrick JB, Tenenbaum JB. 2013. Simulation as an engine of physical scene understanding. Proc. Natl. Acad. Sci. USA 110(45):18327-32
12. Battaglia PW, Schrater PR. 2007. Humans trade off viewing time and movement duration to improve visuomotor accuracy in a fast reaching task. J. Neurosci. 27(26):6984-94
13. Beck J, Ma WJ, Kiani R, Hanks T, Churchland AK, et al. 2008. Bayesian decision making with probabilistic population codes. Neuron 60(6):1142-52
14. Beck JM, Latham PE, Pouget A. 2011. Marginalization in neural circuits with divisive normalization. J. Neurosci. 31(43):15310-19
15. Beck JM, Ma WJ, Pitkow X, Latham PE, Pouget A. 2012. Not noisy, just wrong: the role of suboptimal inference in behavioral variability. Neuron 74(1):30-39
16. Behrens TEJ,Woolrich MW,Walton ME, Rushworth MFS. 2007. Learning the value of information in an uncertain world. Nat. Neurosci. 10(9):1214-21
17. Bejjanki VR, Clayards M, Knill DC, Aslin RN. 2011. Cue integration in categorical tasks: insights from audio-visual speech perception. PLoS ONE 6(5):e19812
18. Berens P, Ecker AS, Cotton RJ, Ma WJ, Bethge M, Tolias AS. 2012. A fast and simple population code for orientation in primate V1. J. Neurosci. 32(31):10618-26
19. Berkes P, Orban G, Lengyel M, Fiser J. 2011. Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331(6013):83-87
20. Braun DA, Mehring C,Wolpert DM. 2010. Structure learning in action. Behav. Brain Res. 206(2):157-65
21. Britten KH, Shadlen MN, Newsome WT, Movshon JA. 1993. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 10(6):1157-69
22. Chen X, Mihalas S, Niebur E, Stuphorn V. 2013. Mechanisms underlying the influence of saliency on valuebased decisions. J. Vis. 13(12):18
23. Churchland AK, Kiani R, Shadlen MN. 2008. Decision-making with multiple alternatives. Nat. Neurosci. 11(6):693-702
24. CicchiniGM, Arrighi R, Cecchetti L, Giusti M, Burr DC. 2012. Optimal encoding of interval timing in expert percussionists. J. Neurosci. 32(3):1056-60
25. DAntona AD, Perry JS, Geisler WS. 2013. Humans make efficient use of natural image statistics when performing spatial interpolation. J. Vis. 13(14):11
26. de Martino B, Fleming SM, Garrett N, Dolan RJ. 2013. Confidence in value-based choice. Nat. Neurosci. 16:105-10
27. Dean AF. 1981. The variability of discharge of simple cells in the cat striate cortex. Exp. Brain Res. 44:437-40
28. Deneve S. 2008. Bayesian spiking neurons I: inference. Neural Comput. 20(1):91-117
29. DiCarlo JJ, Zoccolan D, Rust NC. 2012.Howdoes the brain solve visual object recognition? Neuron 73(3):415-34
30. DorrisMC, Glimcher PW. 2004. Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44(2):365-78
31. Faisal A, Selen LPJ,Wolpert DM. 2008. Noise in the nervous system. Nat. Rev. Neurosci. 9(4):292-303
32. Faisal AA, Wolpert DM. 2009. Near optimal combination of sensory and motor uncertainty in time during a naturalistic perception-action task. J. Neurophysiol. 101(4):1901-12
33. Feng S, Holmes P, Rorie A, Newsome WT. 2009. Can monkeys choose optimally when faced with noisy stimuli and unequal rewards? PLoS Comput. Biol. 5(2):e1000284
34. Fetsch CR, Pouget A,DeAngelis GC, AngelakiDE. 2012. Neural correlates of reliability-based cue weighting during multisensory integration. Nat. Neurosci. 15:146-54
35. Fetsch CR, Turner AH, DeAngelis GC, Angelaki DE. 2009. Dynamic reweighting of visual and vestibular cues during self-motion perception. J. Neurosci. 29(49):15601-12
36. Fiorillo CD,Tobler PN, Schultz W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299(5614):1898-902
37. Fischer BJ, Pena JL. 2011. Owls behavior and neural representation predicted by Bayesian inference. Nat. Neurosci. 14(8):1061-66
38. Fiser J, Berkes P, Orban G, Lengyel M. 2010. Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14(3):119-30
39. Fleming SM, Dolan RJ. 2012. The neural basis of metacognitive ability. Phil. Trans. R. Soc. B 367(1594):1338-49
40. Fleming SM, Maloney LT, Daw ND. 2013. The irrationality of categorical perception. J. Neurosci. 33(49):19060-70
41. Foldiak P. 1993. The ideal homunculus: statistical inference from neural population responses. In Computation and Neural Systems, ed. F Eeckman, J Bower, pp. 55-60. Norwell, MA: Kluwer Acad.
42. Ganguli D, Simoncelli EP. 2011. Implicit encoding of prior probabilities in optimal neural populations. In Advances in Neural Information Processing Systems, ed. J Shawe-Taylor, RS Zemel, P Bartlett, F Pereira, KW Weinberger, pp. 658-66. Cambridge, MA: MIT Press
43. Gershman SJ, Vul E, Tenenbaum JB. 2012. Multistability and perceptual inference. Neural Comput. 24:1-24
44. Ghose GM, Maunsell JH. 2002. Attentional modulation in visual cortex depends on task timing. Nature 419(6907):616-20
45. Girshick AR, Landy MS, Simoncelli EP. 2011. Cardinal rules: visual orientation perception reflects knowledge of environmental statistics. Nat. Neurosci. 14:926-32
46. Glimcher PW, Fehr E, Camerer C, Poldrack RA, eds. 2008. Neuroeconomics: Decision Making and the Brain. New York: Academic
47. Gold JI, Shadlen MN. 2007. The neural basis of decision making. Annu. Rev. Neurosci. 30:535-74
48. Graf AB, Kohn A, Jazayeri M, Movshon JA. 2011. Decoding the activity of neuronal populations in macaque primary visual cortex. Nat. Neurosci. 14(2):239-45
49. Green DM, Swets JA. 1966. Signal Detection Theory and Psychophysics. Los Altos, CA:Wiley
50. Griffiths TL, Vul E, Sanborn AN. 2012. Bridging levels of analysis for probabilisticmodels of cognition. Curr. Dir. Psychol. Sci. 21(4):263-68
51. Gu Y, Angelaki DE, DeAngelis GC. 2008. Neural correlates of multisensory cue integration in macaque MSTd. Nat. Neurosci. 11(10):1201-10
52. Hausmann L, von Campenhausen M, Endler F, Singheiser M, Wagner H. 2009. Improvements of sound localization abilities by the facial ruff of the barn owl (Tyto alba) as demonstrated by virtual ruff removal. PLoS ONE 4:e7721
53. Hikosaka O, Bromberg-Martin E, Hong S, Matsumoto M. 2008. New insights on the subcortical representation of reward. Curr. Opin. Neurobiol. 18(2):203-8
54. Hillis JM, Ernst MO, Banks MS, Landy MS. 2002. Combining sensory information: mandatory fusion within, but not between, senses. Science 298(5598):1627-30
55. Hospedales T, Vijayakumar S. 2009. Multisensory oddity detection as Bayesian inference. PLoS ONE 4(1):e4205
56. Hoyer PO, Hyvarinen A. 2003. Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior. Cambridge, MA: MIT Press
57. Hudson TE, Maloney LT, Landy MS. 2007. Movement planning with probabilistic target information. J. Neurophysiol. 98(5):3034-46
58. Janssen P, Shadlen MN. 2005. A representation of the hazard rate of elapsed time in macaque area LIP. Nat. Neurosci. 8(2):234-41
59. Jazayeri M. 2008. Probabilistic sensory recoding. Curr. Opin. Neurobiol. 18(4):431-37
60. Jazayeri M, Movshon JA. 2006. Optimal representation of sensory information by neural populations. Nat. Neurosci. 9(5):690-96
61. Jazayeri M, Shadlen MN. 2010. Temporal context calibrates interval timing. Nat. Neurosci. 13(8):1020-26
62. Kahneman D, Tversky A. 1979. Prospect theory: an analysis of decision under risk. Econometrica 47:263-91
63. Kemp C, Tenenbaum JB. 2008. The discovery of structural form. Proc. Natl. Acad. Sci. USA 105(31):10687-92
64. Kepecs A, Uchida N, Zariwala HA,Mainen ZF. 2008. Neural correlates, computation and behavioural impact of decision confidence. Nature 455:227-33
65. Kersten D,Mamassian P, Yuille A. 2004. Object perception as Bayesian inference. Annu. Rev. Psychol. 55:271-304
66. Keshvari S, Van den Berg R, MaWJ. 2012. Probabilistic computation in human perception under variability in encoding precision. PLoS ONE 7(6):e40216
67. Kiani R, Shadlen MN. 2009. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324:759-64
68. Komura Y, Nikkuni A, Hirashima N, Uetake T, Miyamoto A. 2013. Responses of pulvinar neurons reflect a subjects confidence in visual categorization. Nat. Neurosci. 16(6):749-55
69. Kording KP,Beierholm U,MaWJ,Quartz S,Tenenbaum JB, Shams L. 2007. Causal inference inmultisensory perception. PLoS ONE 2(9):e943
70. Kording KP, Wolpert DM. 2004. Bayesian integration in sensorimotor learning. Nature 427(6971):244-47
71. Landy MS, Trommershauser J, Daw ND. 2012. Dynamic estimation of task-relevant variance in movement under risk. J. Neurosci. 32(37):12702-11
72. Lau B, Glimcher PW. 2008. Value representations in the primate striatum during matching behavior. Neuron 58(3):451-63
73. LawCT, Gold JI. 2008. Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area. Nat. Neurosci. 11(4):505-13
74. Lee D, Seo H, Jung MW. 2012. Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35:287-308
75. LeeTS, MumfordD. 2003. Hierarchical Bayesian inference in the visual cortex. J.Opt. Soc. Am. 20(7):1434-48
76. Ma WJ. 2012. Organizing probabilistic models of perception. Trends Cogn. Sci. 16(10):511-18
77. Ma WJ, Beck JM, Latham PE, Pouget A. 2006. Bayesian inference with probabilistic population codes. Nat. Neurosci. 9(11):1432-38
78. Ma WJ, Beck JM, Pouget A. 2008. Spiking networks for Bayesian inference and choice. Curr. Opin. Neurobiol. 18:217-22
79. Ma WJ,Navalpakkam V, Beck JM, van den Berg R, Pouget A. 2011. Behavior and neural basis of near-optimal visual search. Nat. Neurosci. 14(6):783-90
80. Ma WJ, Zhou X, Ross LA, Foxe JJ, Parra LC. 2009. Lip-reading aids word recognition most in moderate noise: a Bayesian explanation using high-dimensional feature space. PLoS ONE 4(3):e4638
81. Magnotti JF, Ma WJ, Beauchamp MS. 2013. Causal inference of asynchronous audiovisual speech. Front. Psychol. 4:798
82. Maiworm M, Konig R, Roder B. 2011. Integrative processing of perception and reward in an auditory localization paradigm. Exp. Psychol. 58(3):217-26
83. Maloney LT, Mamassian P. 2009. Bayesian decision theory as a model of human visual perception: testing Bayesian transfer. Vis. Neurosci. 26(1):147-55
84. Mareschal I, Calder AJ, Clifford CWG. 2013. Humans have an expectation that gaze is directed toward them. Curr. Bio. 23(8):717-21
85. Mazyar H, van den Berg R, Seilheimer RL, Ma WJ. 2013. Independence is elusive: set size effects on encoding precision in visual search. J. Vis. 13(5). doi: 10.1167/13.5.8
86. Middlebrooks PG, SommerMA. 2012. Neuronal correlates of metacognition in primate frontal cortex. Neuron 75(3):517-30
87. Miyazaki M, Nozaki D, Nakajima Y. 2005. Testing Bayesian models of human coincidence timing. J. Neurophysiol. 94(1):395-99
88. Moreno-Bote R, Knill DC, Pouget A. 2011. Bayesian sampling in visual perception. Proc. Natl. Acad. Sci. USA 108(30):12491-96
89. Morgan ML, DeAngelis GC, Angelaki DE. 2008. Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59:662-73
90. Najemnik J, GeislerWS. 2005. Optimal eye movement strategies in visual search. Nature 434(7031):387-91
91. OReilly JX, Jbabdi S, Rushworth MFS, Behrens TEJ. 2013. Brain systems for probabilistic and dynamic prediction: computational specificity and integration. PLoS Biol. 11(9):e1001662
92. Orhan AE, Sims CR, Jacobs RA, Knill DC. 2014. The adaptive nature of visual working memory. Curr. Dir. Psychol. Sci. In press
93. Palmer J. 1990. Attentional limits on the perception and memory of visual information. J. Exp. Psychol. Hum. Percept. Perform. 16:332-50
94. Paulin MG. 2005. Evolution of the cerebellum as a neuronal machine for Bayesian state estimation. J. Neural Eng. 2(3):S219-34
95. Peirce CS, Jastrow J. 1884. On small differences of sensation. Mem. Natl. Acad. Sci. 3:73-83
96. Platt ML, Glimcher PW. 1999. Neural correlates of decision variables in parietal cortex. Nature 400(6741):233-38
97. Pouget A, Beck JM, Ma WJ, Latham PE. 2013. Probabilistic brains: knowns and unknowns. Nat. Neurosci. 16:1170-78
98. Pouget A, Dayan P, Zemel RS. 2003. Inference and computation with population codes. Annu. Rev. Neurosci. 26:381-410
99. Preuschoff K, Bossaerts P, Quartz SR. 2006. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51(3):381-90
100. Qamar AT, Cotton RJ, George RG, Beck JM, Prezhdo E, et al. 2013. Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization. Proc. Natl. Acad. Sci. USA 110(50):20332-37
101. Rangel A, CamererC,Montague PR. 2008.Aframework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9(7):545-56
102. Rao RP. 2004. Bayesian computation in recurrent neural circuits. Neural Comput. 16(1):1-38
103. Raphan M, Simoncelli EP. 2011. Least squares estimation without priors or supervision. Neural Comput. 23(2):374-420
104. Rushworth MFS, Behrens TEJ. 2008. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11(4):389-97
105. Sanger T. 1996. Probability density estimation for the interpretation of neural population codes. J. Neurophysiol. 76(4):2790-93
106. SchultzW. 2000. Multiple reward signals in the brain. Nat. Rev. Neurosci. 1(3):199-207
107. Seydell A, McCann BC, Trommershauser J, Knill DC. 2008. Learning stochastic reward distributions in a speeded pointing task. J. Neurosci. 28(17):4356-67
108. Shi L, Griffiths TL, Feldman NH, Sanborn AN. 2010. Exemplar models as a mechanism for performing Bayesian inference. Psychon. Bull. Rev. 17(4):443-64
109. Simoncelli EP. 2009. Optimal estimation in sensory systems. In The Cognitive Neurosciences, Vol. 4, ed. M Gazzanig, pp. 525-35. Cambridge, MA: MIT Press
110. So NY, Stuphorn V. 2010. Supplementary eye field encodes option and action value for saccades with variable reward. J. Neurophysiol. 104(5):2634-53
111. SoftkyWR, Koch C. 1993. The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J. Neurosci. 13(1):334-50
112. Stocker AA, Simoncelli EP. 2006. Noise characteristics and prior expectations in human visual speed perception. Nat. Neurosci. 9(4):578-85
113. Sugrue LP, Corrado GS, Newsome WT. 2004. Matching behavior and the representation of value in the parietal cortex. Science 304(5678):1782-87
114. Tassinari H, Hudson TE, Landy MS. 2006. Combining priors and noisy visual cues in a rapid pointing task. J. Neurosci. 26:10154-63
115. Tenenbaum JB, Griffiths TL. 2001. Generalization, similarity, and Bayesian inference. Behav. Brain Sci. 24(4):629-40; discuss. 652-791
116. Tolhurst D, Movshon J, Dean AF. 1983. The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vis. Res. 23:775-85
117. Trommershauser J, Kording K, Landy MS, eds. 2011. Sensory Cue Integration. New York: Oxford Univ. Press
118. Trommershauser J,MaloneyL,Landy MS. 2008. Decisionmaking, movement planning and statistical decision theory. Trends Cogn. Sci. 12(8):291-97
119. Turnham EJ, Braun DA, Wolpert DM. 2011. Inferring visuomotor priors for sensorimotor learning. PLoS Comput. Biol. 7(3):e1001112
120. van den Berg R, Vogel M, Josic K, Ma WJ. 2012. Optimal inference of sameness. Proc. Natl. Acad. Sci. USA 109(8):3178-83
121. Vilares I, Howard JD, Fernandes HL, Gottfried JA, Kording KP. 2012. Differential representations of prior and likelihood uncertainty in the human brain. Curr. Biol. 22(18):1641-48
122. Vilares I, Kording KP. 2011. Bayesian models: the structure of the world, uncertainty, behavior, and the brain. Ann. NY Acad. Sci. 1224:22-39
123. Whiteley L, Sahani M. 2008. Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes. J. Vis. 8(3):1-15
124. Whiteley L, Sahani M. 2012. Attention in a Bayesian framework. Front. Hum. Neurosci. 6:100
125. Yang T, Shadlen MN. 2007. Probabilistic reasoning by neurons. Nature 447:1075-80