Optimal decision making on the basis of evidence represented in spike trains

Neural Computation

Volumn 22, Issue 5, 2010, Pages 1113-1148

  Zhang, Jiaxiang ^a,b   Bogacz, Rafal ^b  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ALGORITHM; ARTICLE; BASAL GANGLION; BIOLOGICAL MODEL; BRAIN CORTEX; COMPUTER SIMULATION; DECISION MAKING; HUMAN; NERVE CELL; NERVE TRACT; NEUROPSYCHOLOGICAL TEST; NORMAL DISTRIBUTION; PHYSIOLOGY; POISSON DISTRIBUTION; SENSORY RECEPTOR; TIME;

ACTION POTENTIALS; ALGORITHMS; BASAL GANGLIA; CEREBRAL CORTEX; COMPUTER SIMULATION; DECISION MAKING; HUMANS; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NEURONS; NEUROPSYCHOLOGICAL TESTS; NORMAL DISTRIBUTION; POISSON DISTRIBUTION; SENSORY RECEPTOR CELLS; TIME FACTORS;

EID: 77953345988     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2009.05-09-1025     Document Type: Article

References (63)

1. Barnard, G.A. (1946). Sequential tests in industrial statistics. Journal of the Royal Statistical Society, 8(1), 1-26.
2. Baum, C., &Veeravalli, V. (1994).Asequential procedure for multihypothesis testing. IEEE Transactions on Information Theory, 40, 1994-2007.
3. Beck, J., Ma, W.J., Kiani, R., Hanks, T., Churchland, A.K., Roitman, J., et al. (2008). Probabilistic population codes for Bayesian decision making. Neuron, 60, 1142-1152.
4. Bogacz, R. (2009). Optimal decision-making theories. In J.-C. Dreher & L. Tremblay (Eds.), Handbook of reward and decision making (pp. 375-397). Orlando, FL: Academic Press.
5. Bogacz, R., Brown, E., Moehlis, J., Hu, P., Holmes, P., & Cohen, J. (2006). The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced choice. Psychological Review, 113, 700-765.
6. Bogacz, R., & Gurney, K. (2007). The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Computation, 19, 442-477.
7. Bogacz, R., Hu, P., Holmes, P., & Cohen, J. (in press). Do humans produce the speedaccuracy tradeoff that maximizes reward rate? Quarterly Journal of Experimental Psychology.
8. Bogacz, R., Usher, M., Zhang, J., & McClelland, J. (2007). Extending a biologically inspired model of choice: Multi-alternatives, nonlinearity and value-based multidimensional choice. Philosophical Transactions of the Royal Society, Series B, 362, 1655-1670.
9. Bogacz, R., Usher, M., Zhang, J., &McClelland, J. (in press). Extending a biologically inspired model of choice: Multi-alternatives, nonlinearity and value-based multidimensional choice. In A. Seth, T. Prescott, & J. Bryson (Eds.), Modelling natural action selection. Cambridge: Cambridge University Press.
10. Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992). The analysis of visual motion: A comparison of neuronal and psychophysical performance. Journal of Neuroscience, 12, 4745-4765.
11. Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1993). Responses of neurons in macaque MT to stochastic motion signals. Visual Neuroscience, 10, 1157-1169.
12. Brown, E., Gao, J., Holmes, P., Bogacz, R., Gilzenrat, M., &Cohen, J.D. (2005). Simple neural networks that optimize decisions. International Journal of Bifurcation and Chaos, 15(3), 803-826.
13. Churchland, A.K., Kiani, R., &Shadlen, M.N. (2008).Decision making with multiple alternatives. Nature Neuroscience, 11, 693-702.
14. Diederich, A., & Busemeyer, J. (2006). Modeling the effects of payoff on response bias in a perceptual discrimination task: Bound-change, drift-rate-change, or twostage-processing hypothesis. Perception and Psychophysics, 68(2), 194-207.
15. Dragalin, V.P., Tartakovsky, A., &Veeravalli, V.V. (1999).Multihypothesis sequential probability ratio tests. I. asymptoticoptimality. Information Theory, IEEE Transactions on Information Theory, 45(7), 2448-2461.
16. Dubner, R., & Zeki, Z. (1971). Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. Brain Research, 35(2), 528-532.
17. Forstmann, B.U., Dutilh, G., Brown, S., Neumann, J., von Cramon, D.Y., Ridderinkhof, K.R., et al. (2008). Striatum and pre-SMA facilitate decision-making under time pressure. Proc. Natl. Acad. Sci. USA, 105(45), 17538-17542.
18. Gold, J., & Shadlen, M. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5, 10-16.
19. Gold, J., &Shadlen, M. (2002). Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions and reward. Neuron, 36, 299-308.
20. Gold, J., & Shadlen, M. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535-574.
21. Hallworth, N., Wilson, C., & Bevan, M. (2003). Apamin-sensitive small conductance calcium-activated potassium channels, through their selective coupling to voltagegated calcium channels, are critical determinants of the precision, pace, and pattern of action potential generation in rat subthalamic nucleus neurons in vitro. Journal of Neuroscience, 23, 7525-7542.
22. Jazayeri, M., &Movshon, J.A. (2006).Optimal representation of sensory information by neural populations. Nature Neuroscience, 9, 690-696.
23. Kenney, J.F., & Keeping, E.S. (1951). Mathematics of statistics (2nd ed.). Princeton, NJ: Van Nostrand.
24. Kiani, R., Hanks, T., & Shadlen, M. (2008). Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. Journal of Neuroscience, 28(12), 3017-3029.
25. Kim, J.N., &Shadlen, M.N. (1999).Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nature Neuroscience, 2, 176-185.
26. Laming, D. (1968). Information theory of choice reaction time. New York:Wiley.
27. Luce, R. (1986). Response times and their role in inferring elementary mental organization. New York: Oxford University Press.
28. Ma, W.J., Beck, J.M., Latham, P.E., & Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nature Neuroscience, 9, 1432-1438.
29. Maunsell, J., & Van Essen, D.C. (1983a). Functional properties of neurons in middle temporal visual area of the macaquemonkey. I. Selectivity for stimulus direction, speed, and orientation. Journal of Neurophysiology, 49(5), 1127-1147.
30. Maunsell, J., & Van Essen, D.C. (1983b). Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. Journal of Neurophysiology, 49(5), 1148-1167.
31. Mazurek, M., Roitman, J., Ditterich, J., & Shadlen, M. (2003). A role for neural integrators in perceptual decision making. Cerebral Cortex, 13, 1257-1269.
32. McMillan, T., & Holmes, P. (2006). The dynamics of choice among multiple alternatives. Journal of Mathematical Psychology, 50, 30-57.
33. Nambu, A., & Llinas, R. (1994). Electrophysiology of globus pallidus neurons in vitro. Journal of Neurophysiology, 72, 1127-1139.
34. Newsome, W.T., & Par'e, E. B. (1988). A selective impairment of motion perception following lesions of the middle temporal visual area (MT). Journal of Neuroscience, 8, 2201-22711.
35. Niwa, M., & Ditterich, J. (2008). Perceptual decisions between multiple directions of visual motion. Journal of Neuroscience, 28(17), 4435-4445.
36. Papoulis, A. (1986). Probability, random variables, and stochastic processes (2nd ed.). New York: McGraw-Hill.
37. Pike, A.R. (1966). Stochastic models of choice behaviour: Response probabilities and latencies of finite Markov chain systems. British Journal of Mathematical and Statistical Psychology, 19(1), 15-32.
38. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 95, 238-255.
39. Ratcliff, R. (1988). Continuous versus discrete information processing: Modeling accumulation of partial information. Psychological Review, 95, 238-255.
40. Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural computation, 20(4), 873-922.
41. Ratcliff, R., & Smith, P.L. (2004). A comparison of sequential sampling models for two-choice reaction time. Psychology Review, 111, 333-367.
42. Roitman, J.D., & Shadlen, M.N. (2002). Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience, 22, 9475-9489.
43. Schall, J. (2001). Neural basis of deciding, choosing and acting. Nature Reviews Neuroscience, 2, 33-42.
44. Schall, J. (2002). The neural selection and control of saccades by the frontal eye field. Philosophical Transactions of the Royal Society B: Biological Sciences, 357, 1073-1082.
45. Shadlen, M., Hanks, T., Churchland, A., Kiani, R., & Yang, T. (2006). The speed and accuracy of a simple perceptual decision: A mathematical primer. In K. Doya, S. Ishii, R. Rao, & A. Pouget (Eds.), Bayesian brain: Probabilistic approaches to neural coding. Cambridge, MA: MIT Press.
46. Shadlen, M.N., &Newsome, W.T. (1998). The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding. Journal of Neuroscience, 18, 3870-3896.
47. Shadlen, M.N., & Newsome, W.T. (2001). Neural basis of a perceptual decision in the parietal cortex (area lip) of the rhesus monkey. Journal of Neurophysiology, 86, 1916-1936.
48. Simen, P., Cohen, J., & Holmes, P. (2006). Rapid decision threshold modulation by reward rate in a neural network. Neural Networks, 19, 1013-1026.
49. Simen, P., Contreras, D., Buck, C., Hu, P., Holmes, P., & Cohen, J. (in press). Reward rate optimization in two-alternative decision making: Empirical tests of theoretical predictions. Journal of Experimental Psychology: Human Perception and Performance.
50. Smith, P.L., & Van Zandt, T. (2000). Time-dependent Poisson counter models of response latency in simple judgment. British Journal of Mathematical and Statistical Psychology, 53(2), 293-315.
51. Smith, W.L. (1959). On the cumulants of renewal processes. Biometrika, 46(1), 1-29.
52. Snowden, R.J., Treue, S., & Andersen, R.A. (1992). The response of neurons in areas V1 and MT of the alert rhesus monkey to moving random dot patterns. Experimental Brain Research, 88, 389-400.
53. Softky, W.R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. Journal of Neuroscience, 113, 334-350.
54. Tolhurst, D.J., Movshon, J.A., & Dean, A.F. (1983). The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Research, 23(8), 775-785.
55. Usher, M., & McClelland, J.L. (2001). On the time course of perceptual choice: The leaky competing accumulator model. Psychological Review, 108, 550-592.
56. Vickers, D. (1970). Evidence for an accumulator model of psychophysical discrimination. Ergonomics, 13(1), 37-58.
57. Wald, A. (1947). Sequential analysis. New York: Wiley.
58. Wald, A., & Wolfwitz, J. (1948). Optimum character of the sequential probability ratio test. Annals of Mathematical Statistics, 19, 326-339.
59. Wilson, C., Weyrick, A., Terman, D., Hallworth, N., & Bevan, M. (2004). A model of reverse spike frequency adaptation and repetitive firing of subthalamic nucleus neurons. Journal of Neurophysiology, 91, 1963-1980.
60. Wolfart, J., Debay, D., Le Masson, G., Destexhe, A., & Bal, T. (2005). Synaptic background activity controls spike transfer from thalamus to cortex. Nature Neuroscience, 8, 1760-1767.
61. Wong, K., &Wang, X. (2006). A recurrent network mechanism of time integration in perceptual decisions. Journal of Neuroscience, 26(4), 1314-1328.
62. Zeki, S.M. (1980). The response properties of cells in the middle temporal area (area MT) of owl monkey visual cortex. Proceedings of the Royal Society of London, Series B, 207(1167), 239-248.
63. Zohary, E., Shadlen, M., & Newsome, W. (1994). Correlated neuronal discharge rate and its implications for psychophysical performance. Nature, 370, 140-143.