Making decisions with unknown sensory reliability

Frontiers in Neuroscience

Volumn , Issue JUN, 2012, Pages

  Deneve, Sophie ^a,b  

^a ECOLE NORMALE SUPÉRIEURE   (France)

^b l'alimentation et l'Environnement   (France)

Author keywords

Adaptation; Bayesian; Decision making; Decision threshold; Evidence; Expectation maximization; Prior; Uncertainty

Indexed keywords

ARTICLE; BAYES THEOREM; CONTROLLED STUDY; DECISION MAKING; LEARNING; NERVOUS SYSTEM; NERVOUS SYSTEM DEVELOPMENT; NONHUMAN; SENSORY STIMULATION;

EID: 84862637485     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2012.00075     Document Type: Article

References (43)

1. Beck, J. M., Ma,W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., and Pouget, A. (2008). Probabilistic population codes for Bayesian decision making. Neuron 60, 1142-1152.
2. Behrens, T. E.,Woolrich, M.W.,Walton, M. E., and Rushworth, M. F. (2007). Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214-1221.
3. Bienenstock, E. L., Cooper, L. N., and Munro, P.W. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32-48.
4. Britten, K. H., Shadlen, M. N., Newsome, W. T., and Movshon, J. A. (1992). The analysis of visual motion: a comparison of neuronal and psychophysical performance. J. Neurosci. 12, 4745-4765.
5. Churchland, A. K., Kiani, R., Chaudhuri, R.,Wang, X. J., Pouget, A., and Shadlen, M. N. (2011). Variance as a signature of neural computations during decision making. Neuron 69, 818-831.
6. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441, 876-879.
7. Dayan, P., and Daw, N. D. (2008). Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 8, 429-453
8. Deneve, S. (2008a). Bayesian spiking neurons I: inference.NeuralComput. 20, 91-117
9. Deneve, S. (2008b). Bayesian spiking neurons II: learning.Neural Comput. 20, 118-145
10. Ditterich, J. (2006). Computational approaches to visual decision making. Novartis Found. Symp. 270, 114-126. [Discussion]
11. Doya, K. (2002). Metalearning and neuromodulation. Neural Netw. 15, 495-506
12. Drugowitsch, J., Moreno-Bote, R., Churchland, A. K., Shadlen, M. N., and Pouget, A. (2012). The cost of accumulating evidence in perceptual decision making. J. Neurosci. 32, 3612-3628
13. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433
14. Ferguson, T. (1967). Mathematical Statistics: A Decision Theoretic Approach. New York: Academic Press
15. Gold, J. I., Law, C. T., Connolly, P., and Bennur, S. (2008). The relative influences of priors and sensory evidence on an oculomotor decision variable during perceptual learning. J. Neurophysiol. 5, 2653-2668
16. Gold, J. I., and Shadlen, M. N. (2002). Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36, 299-308
17. Gold, J. I., and Shadlen, M. N. (2003). The influence of behavioral context on the representation of a perceptual decision in developing oculomotor commands. J. Neurosci. 23, 632-651
18. Hanks, T. D.,Mazurek, M. E., Kiani, R., Hopp, E., and Shadlen,M.N. (2011). Elapsed decision time affects the weighting of prior probability in a perceptual decision task. J. Neurosci. 31, 6339-6352
19. Kiani, R., Hanks, T. D., and Shadlen, M. N. (2008). Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J. Neurosci. 28, 3017-3029
20. Kiani, R., and Shadlen, M. N. (2009). Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324, 759-764
21. Knill, D. C., and Pouget, A. (2004). The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27, 712-719
22. Laming, D. R. J. (1968). Information Theory and Choice Reaction Time. New York: Academic Press
23. Law, C. T., and Gold, J. I. (2009). Reinforcement learning can account for associative and perceptual learning on a visual-decision task. Nat. Neurosci. 12, 655-663
24. Link, S. W. (1992). The Wave Theory of Difference and Similarity. Hillsdale, NJ: Lawrence Erlbaum Associates
25. Mazurek, M. E., Roitman, J. D., Roitman, J. D.,Ditterich, J., and Shadlen, M. N. (2003). A role for neural integrators in perceptual decision making. Cereb. Cortex 13, 1257-1269
26. Mongillo, G., and Deneve, S. (2008). Online learning with hidden markov models. Neural Comput. 20, 1706-1716
27. Newsome, W. T., Britten, K. H., and Movshon, J. A. (1989). Neural correlates of a perceptual decision. Nature 341, 52-54
28. Palmer, J., McKinley, M. K., Mazurek, M., and Shadlen, M. N. (2005). Effect of prior probability on choice and response time in a motion discrimination task. J. Vis. 5, 235-235
29. Ratcliff, R., Cherian, A., and Segraves, M. (2003). A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of twochoice decisions. J. Neurophysiol. 90, 1392-1407
30. Ratcliff, R., andMcKoon,G. (2008). The diffusion decisionmodel: theory and data for two-choice decision tasks. Neural Comput. 20, 873-922
31. Shadlen, M. N., Britten, K. H., Newsome, W. T., and Movshon, J. A. (1996). A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J. Neurosci. 16, 1486-1510
32. Shadlen, M. N., and Newsome, W. T. (1998). The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J. Neurosci. 18, 3870-3896
33. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2004).Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787
34. Walton,M. E.,Croxson,P. L., Behrens,T. E., Kennerley, S.W., and Rushworth, M. F. (2007).Adaptive decision making and value in the anterior cingulate cortex. Neuroimage 36(Suppl. 2), T142-T154
35. Wang, X. J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968
36. Wang, X. J. (2008). Decision making in recurrent neuronal circuits. Neuron 60, 215-234
37. Whiteley, L., and Sahani, M. (2008). Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes. J. Vis. 8, 2 1-15
38. Wolpert, D. M. (2007). Probabilistic models in human sensorimotor control. Hum. Mov. Sci. 26, 511-524
39. Wong, K. F., Huk, A. C., Shadlen, M. N., and Wang, X. J. (2007). Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Front. Comput. Neurosci. 1:6. doi:10.3389/neuro.10.006.2007
40. Wong, K. F., and Wang, X. J. (2006). A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 26, 1314-1328
41. Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692
42. Yuille, A. L., and Bülthoff, H. H. (1996). " Bayesian decision theory and psychophysics," in Perception as Bayesian Inference, eds D. C. Knill and W. Richards (New York: Cambridge University Press), 123-162
43. Zemel, R. S., Dayan, P., and Pouget, A. (1998). Probabilistic interpretation of population codes.NeuralComput. 10, 403-430