Computational models of decision making: Integration, stability, and noise

Current Opinion in Neurobiology

Volumn 22, Issue 6, 2012, Pages 1047-1053

  Cain, Nicholas ^a   Shea Brown, Eric ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTIFACT; BIOLOGICAL MODEL; BRAIN; COMPUTER SIMULATION; DECISION MAKING; HUMAN; PHYSIOLOGY; REVIEW; SENSATION;

ANIMALS; ARTIFACTS; BRAIN; COMPUTER SIMULATION; DECISION MAKING; HUMANS; MODELS, NEUROLOGICAL; SENSATION;

EID: 84878194330     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2012.04.013     Document Type: Review

References (76)

1. Bogacz R., Brown E., Holmes P., Cohen J.D. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 2006, 113:700-765.
2. Laming D.R.J. Information Theory of Choice-Reaction Times 1968, Academic Press, New York.
3. Ratcliff R. A theory of memory retrieval. Psych Rev 1978, 85:59-108.
4. Ratcliff R., Van Zandt T., McKoon G. Connectionist and diffusion models of reaction time. Psych Rev 1999, 106:261-300.
5. Shadlen M.N., Newsome W.T. Motion perception: seeing and deciding. PNAS 1996, 93:628-633.
6. Stone M. Models for choice-reaction time. Psychometrika 1960, 25:251-260.
7. Usher M., McClelland J.L. The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev 2001, 108:550-592.
8. Gold J., Shadlen M. Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 2002, 36:299-308.
9. Zacksenhouse M., Bogacz R., Holmes P. Robust versus optimal strategies for two-alternative forced choice tasks. J Math Psychol 2010, 54:230-246.
10. Beck J.M., Ma W.J., Kiani R., Hanks T., Churchland A.K., Roitman J., Shadlen M.N., Latham P.E., Pouget A. Probabilistic population codes for Bayesian decision making. Neuron 2008, 60:1142-1152.
11. Smith P.L., Ratcliff R. Psychology and neurobiology of simple decisions. Trends Neurosci 2004, 27:161-168.
12. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu Rev Neurosci 2007, 30:535-574.
13. Wald A., Wolfowitz J. Optimum character of the sequential probability ratio test. Annals Math Statistics 1948, 19:326-339.
14. Link S.W. The Wave Theory of Difference and Similarity 1992, Lawrence Erlbaum.
15. Smith P.L. From Poisson shot noise to the integrated Ornstein-Uhlenbeck process: neurally principled models of information accumulation in decision-making and response time. J Math Psychol 2010, 54:266-283.
16. Zhang J., Bogacz R. Optimal decision making on the basis of evidence represented in spike trains. Neural Comput 2010, 22:1113-1148.
17. Moreno-Bote R. Decision confidence and uncertainty in diffusion models with partially correlated neuronal integrators. Neural Comput 2010, 22:1786-1811.
18. Brown E., Gao J., Holmes P., Bogacz R., Gilzenrat M., Cohen J. Simple networks that optimize decisions. Int J Bifurcation Chaos 2005, 15:803-826.
19. Churchland A.K., Kiani R., Chaudhuri R., Wang X.-J., Pouget A., Shadlen M.N. Variance as a signature of neural computations during decision making. Neuron 2011, 69:818-831.
20. Kiani R., Hanks T.D., Shadlen M.N. Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J Neurosci 2008, 28:3017-3029.
21. Bogacz R., Hu P., Holmes P., Cohen J.D. Do humans produce the speed-accuracy tradeoff that maximizes reward rate?. Quart J Exp Psych 2010, 63:863-891.
22. Edwards W. Optimal strategies for seeking information: models for statistics, choice reaction times, and human information processing. J Math Psychol 1965, 2:312-329.
23. Maddox W.T., Bohil C.J. Base-rate and payoff effects in multidimensional perceptual categorization. J Exp Psychol 1998, 24:1459-1482.
24. Bogacz R., Gurney K. The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 2007, 19:442-477.
25. McMillen T., Holmes P. The dynamics of choice among multiple alternatives. J Math Psychol 2006, 50:30-57.
26. Wong K.F., Wang X.J. A recurrent network mechanism of time integration in perceptual decisions. J Neurosci 2006, 26:1314-1328.
27. Goldman MS, Compte A, Wang X-J: Neural integrator models. In: Squire LR, editor. Encyclopedia of Neuroscience, 6:165-178, 2009.
28. Machens C.K., Romo R., Brody C.D. Flexible dynamics of mutual inhibition: a neural model of two-interval discrimination. Science 2005, 307:1121-1124.
29. Pouget A., Latham P. Digitized neural networks: long-term stability from forgetful neurons. Nat Neurosci 2002, 5:709-710.
30. Robinson D.A. Integrating with neurons. Ann Rev Neurosci 1989, 12:33-45.
31. Seung H.S. How the brain keeps the eyes still. Proc Natl Acad Sci 1996, 93:13339-13344.
32. Bogacz R. Optimal decision-making theories: linking neurobiology with behavior. Trends Cogn Sci 2007, 11:118-125.
33. Brown E., Holmes P. Modeling a simple choice task: stochastic dynamics of mutually inhibitory neural groups. Stochastics Dynam 2001, 1:159-191.
34. Wang X.-J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
35. Roxin A., Ledberg A. Neurobiological models of two-choice decision making can be reduced to a one-dimensional nonlinear diffusion equation. PLoS Comput Biol 2008, 4:e1000046.
36. Ganguli S., Bisley J., Roitman J., Shadlen M., Goldberg M., Miller K. One-dimensional dynamics of attention and decision making in lip. Neuron 2008, 58:15-28.
37. Ganguli S., Huh D., Sompolinsky H. Memory traces in dynamical systems. PNAS 2008, 105:18970-18975.
38. Goldman M.S. Memory without feedback in a neural network. Neuron 2009, 61:621-634.
39. Lim S., Goldman M.S. Noise tolerance of attractor and feedforward memory models. Neural Comput 2012, 24:332-390.
40. Miri A., Daie K., Arrenberg A.B., Baier H., Aksay E., Tank D.W. Spatial gradients and multidimensional dynamics in a neural integrator circuit. Nat Neurosci 2011, 14:1150-1159.
41. Koulakov A., Raghavachari S., Kepecs A., Lisman J. Model for a robust neural integrator. Nat Neurosci 2002, 5:775-782.
42. Goldman M.S., Levine J.H., Major G., Tank D.W., Seung H.S. Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. Cerebral Cortex 2003, 1:1185-1195.
43. Field G.D., Sampath A.P., Rieke F. Retinal processing near absolute threshold: from behavior to mechanism. Annu Rev Physiol 2005, 67:491-514.
44. Green D., Swets J. Signal Detection Theory and Psychophysics 1966, Peninsula Pub.
45. Smith P.L., Vickers D. Modeling evidence accumulation with partial loss in expanded judgment. J Exp Psychol Human Perception Performance 1989, 15:797.
46. Purcell B.A., Heitz R.P., Cohen J.Y., Schall J.D., Logan G.D., Palmeri T.J. Neurally constrained modeling of perceptual decision making. Psychol Rev 2010, 117:1113-1143.
47. Schall J.D., Purcell B.A., Heitz R.P., Logan G.D., Palmeri T.J. Neural mechanisms of saccade target selection: gated accumulator model of the visual-motor cascade. Eur J Neurosci 2011, 33:1991-2002.
48. Miller P. Power-law neuronal fluctuations in a recurrent network model of parametric working memory. J Neurophysiol 2006, 95:1099-1114.
49. Cain N., Barreiro A., Shadlen M., Shea-Brown E. A favorable tradeoff between robustness and performance in sequential decision tasks. Cosyne Abstracts 2011.
50. Raposo D, Sheppard JP, Schrater PR, Churchland AK: Multisensory decision-making in rats and humans. J Neurosci 2012, 32:3726-3735.
51. Churchland A.K., Kiani R., Shadlen M.N. Decision-making with multiple alternatives. Nat Neurosci 2008, 11:693-702.
52. Roitman J.D., Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci 2002, 22:9475-9489.
53. Shea-Brown E., Gilzenrat M., Cohen J.D. Optimization of decision making in multilayer networks: The role of locus coeruleus. Neural Comput 2008, 20:2863-2894.
54. Aston-Jones G., Cohen J.D. An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu Rev Neurosci 2005, 28:403-450.
55. Eckhoff P., Wong-Lin K.F., Holmes P. Optimality and robustness of a biophysical decision-making model under norepinephrine modulation. J Neurosci 2009, 29:4301-4311.
56. Usher M., Cohen J.D., Servan-Schreiber D., Rajkowsky J., Aston-Jones G. The role of locus coeruleus in the regulation of cognitive performance. Science 1999, 283:549-554.
57. Drugowitsch J., Moreno-Bote R., Churchland A.K., Shadlen M.N., Pouget A. The cost of accumulating evidence in perceptual decision making. J Neurosci 2012, 32:3612-3628.
58. Frazier P., Yu A. Sequential hypothesis testing under stochastic deadlines. Advances in Neural Information Processing Systems, vol. 20 2008, 465-472. MIT Press, Cambridge, MA. J.C. Platt, D. Koller, Y. Singer, S. Roweis (Eds.).
59. Huang Y., Friesen A., Rao R. How prior probability influences decision making: a unifying probabilistic model. Cosyne Abstracts 2012.
60. Rao R.P.N. Decision making under uncertainty: a neural model based on partially observable markov decision processes. Front Comput Neurosci 2010, 4.
61. Ditterich J. Evidence for time-variant decision making. Eur J Neurosci 2006, 24:3628-3641.
62. Wong K.F., Huk A.C., Shadlen M.N., Wang X.J. Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Front Comput Neurosci 2007, 1:1-11.
63. Dayan P., Yu A.J. Phasic norepinephrine: A neural interrupt signal for unexpected events. Network: Comput Neural Syst 2006, 17:335-350.
64. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci 1992, 12:4745-4765.
65. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. Responses of neurons in macaque MT to stochastic motion signals. Visual Neurosci 1993, 10:1157-1169.
66. Cohen M., Newsome W. Estimates of the contribution of single neurons to perception depend on timescale and noise correlation. J Neurosci 2009, 29:6635-6648.
67. Zohary E., Shadlen M.N., Newsome W.T. Correlated neuronal discharge rate and its implication for psychophysical performance. Nature 1994, 370:140.
68. Mazurek M.E., Roitman J.D., Ditterich J., Shadlen M.N. A role for neural integrators in perceptual decision making. Cerebral Cortex 2003, 13:1257-1269.
69. Shadlen M., Britten K., Newsome W., Movshon J. A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J Neurosci 1996, 16:1486-1510.
70. Deco G., Rolls E.T., Romo R. Stochastic dynamics as a principle of brain function. Progr Neurobiol 2009, 88:1-16.
71. Smith P.L., McKenzie C.R.L. Diffusive information accumulation by minimal recurrent neural models of decision making. Neural Comput 2011, 23.
72. Simen P., Balci F., deSouza L., Cohen J.D., Holmes P. A model of interval timing by neural integration. J Neurosci 2011, 31:9238-9253.
73. Wang X.-J. Decision making in recurrent neuronal circuits. Neuron 2008, 60:215-234.
74. Webb T.J., Rolls E.T., Deco G., Feng J. Noise in attractor networks in the brain produced by graded firing rate representations. PLoS One 2011, 6:e23630.
75. Doiron B., Litwin-Kumar A., Polk A. Correlated variability stabilizes persistent activity in networks of spiking neurons. Abstract 451.23. Soc Neurosci 2011.
76. Boerlin M., Denève S. Spike-based population coding and working memory. PLoS Comput Biol 2011, 7:e1001080.