The basal ganglia optimize decision making over general perceptual hypotheses

Neural Computation

Volumn 24, Issue 11, 2012, Pages 2924-2945

  Lepora, Nathan F ^a   Gurney, Kevin N ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BASAL GANGLION; BAYES THEOREM; BIOLOGICAL MODEL; DECISION MAKING; HUMAN; NERVE TRACT; NORMAL DISTRIBUTION; PHYSIOLOGY; REINFORCEMENT;

BASAL GANGLIA; BAYES THEOREM; DECISION MAKING; HUMANS; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NORMAL DISTRIBUTION; REINFORCEMENT (PSYCHOLOGY);

EID: 84874204648     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00360     Document Type: Article

References (64)

1. Albin, R., Young, A., & Penney, J. (1989). The functional anatomy of basal ganglia disorders. Trends in Neurosciences, 12(10), 366-375.
2. Baum,C., & Veeravalli,V. (1994).Asequential procedure for multihypothesis testing. IEEE Transactions on Information Theory, 40(6), 1994-2007.
3. Beck, J., Ma, W., Kiani, R., Hanks, T., Churchland, A., Roitman, J., et al. (2008). Probabilistic population codes for Bayesian decision making. Neuron, 60(6), 1142-1152.
4. Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. (2006). The physics of optimal decision making: A formal analysis of models of performance in twoalternative forced-choice tasks. Psychological Review, 113(4), 1-72.
5. Bogacz, R., & Gurney, K. (2007). The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Computation, 19(2), 442-477.
6. Bogacz, R., & Larsen, T. (2011). Integration of reinforcement learning and optimal decision-making theories of the basal ganglia. Neural Computation, 23, 1-35.
7. Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1993). Responses of neurons in macaque MT to stochastic motion signals. Visual Neuroscience, 10, 1157-1169.
8. Buesing, L., Bill, J., Nessler, B., & Maass, W. (2011). Neural dynamics as sampling: A model for stochastic computation in recurrent networks of spiking neurons. PLoS Computational Biology, 7(11), e1002211.
9. Chevalier, G., & Deniau, J. (1990). Disinhibition as a basic process in the expression of striatal functions. Trends in Neurosciences, 13(7), 277-280.
10. Churchland, A., Kiani, R., & Shadlen, M. (2008). Decision-making with multiple alternatives. Nature Neuroscience, 11(6), 693-702.
11. Deneve, S. (2008). Bayesian spiking neurons I: Inference. Neural Computation, 20(1), 91-117.
12. Ding, L., & Gold, J. (2010). Caudate encodes multiple computations for perceptual decisions. Journal of Neuroscience, 30(47), 15747-15759.
13. Doya, K. (2000). Complementary roles of basal ganglia and cerebellum in learning and motor control. Current Opinion in Neurobiology, 10(6), 732-739.
14. Dragalin, V., Tartakovsky, A., & Veeravalli, V. (1999). Multihypothesis sequential probability ratio tests. I. Asymptotic optimality. IEEE Transactions on Information Theory, 45(7), 2448-2461.
15. Forstmann, B.,Anwander, A., Scḧfer, A., Neumann, J., Brown, S.,Wagenmakers, E., et al. (2010). Cortico-striatal connections predict control over speed and accuracy in perceptual decision making. Proceedings of the National Academy of Sciences, 107(36), 15916-15920.
16. Forstmann, B., Dutilh, G., Brown, S., Neumann, J., Von Cramon, D., Ridderinkhof, K., et al. (2008). Striatum and pre-SMA facilitate decision-making under time pressure. Proceedings of the National Academy of Sciences, 105(45), 17538-17542.
17. Frank, M. (2005). Dynamic dopaminemodulation in the basal ganglia: A eurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience, 17(1), 51-72.
18. Frank, M. (2006). Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making. Neural Networks, 19(8), 1120-1136.
19. Frank, M., Doll, B., Oas-Terpstra, J., & Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12(8), 1062-1068.
20. Frazier, P., & Yu, A. (2008). Sequential hypothesis testing under stochastic eadlines. In J. C. Platt, D. Koller, Y. Singer, & S. Roweis (Eds.), Advances in neural information processing systems, 20 (pp. 465-472). Cambridge, MA: MIT Press.
21. Gerfen, C., & Wilson, C. (1996). The basal ganglia. In L.W. Swanson, A. Bj̈rklund, & T. Ḧkfelt (Eds.), Handbook of chemical neuroanatomy, 12 (pp. 371-468). New York: Elsevier.
22. Gold, J., & Shadlen, M. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5(1), 10-16.
23. Gold, J., & Shadlen, M. (2007). The neural basis of decision making. Annu. Rev. Neurosci., 30, 535-574.
24. Graf, A., Kohn, A., Jazayeri, M., & Movshon, J. (2011). Decoding the activity of neuronal populations in macaque primary visual cortex. Nature Neuroscience, 14, 239-245.
25. Gurney, K., Prescott, T., & Redgrave, P. (2001). A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biological Cybernetics, 84(6), 401-410.
26. Huk, A., & Shadlen, M. (2005). Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. Journal of Neuroscience, 25(45), 10420-10436.
27. Humphries,M., & Gurney, K. (2002). The role of intra-thalamic and thalamocortical circuits in action selection. Network: Computation in Neural Systems, 13(1), 31-156.
28. Humphries, M., Khamassi, M., & Gurney, K. (2012). Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia. Frontiers in Neuroscience, 6.
29. Humphries,M., Stewart, R., & Gurney, K. (2006). A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. Journal of Neuroscience, 26(50), 12921-12942.
30. Jazayeri, M., & Movshon, J. (2006). Optimal representation of sensory information by neural populations. Nature Neuroscience, 9(5), 690-696.
31. Jones, E., Coulter, J., & Hendry, S. (1978). Intracortical connectivity of architectonic fields in the somatic sensory, motor and parietal cortex of monkeys. Journal of Comparative Neurology, 181(2), 291-347.
32. Jones, E., Coulter, J., Burton, H., & Porter, R. (1977). Cells of origin and terminal distribution of corticostriatal fibers arising in the sensory-motor cortex of monkeys. Journal of Comparative Neurology, 173(1), 53-80.
33. Kersten, D., Mamassian, P., & Yuille, A. (2004). Object perception as Bayesian inference. Annual Review of Psychology, 55, 271-304.
34. Kim, J., & Shadlen, M. (1999). Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nature Neuroscience, 2, 176-185.
35. Knill, D., & Pouget, A. (2004). The Bayesian brain: The role of uncertainty in neural coding and computation. Trends in Neurosciences, 27(12), 712-719.
36. Lepora, N., Fox, C., Evans, M., Diamond, M., Gurney, K., & Prescott, T. (2012). Optimal decision-making in mammals: Insights from a robot study of rodent texture discrimination. Journal of the Royal Society Interface, 9, 1517-1528.
37. Lo, C., & Wang, X. (2006). Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nature Neuroscience, 9(7), 956-963.
38. Mazurek, M., Roitman, J., Ditterich, J., & Shadlen, M. (2003). A role for neural integrators in perceptual decision making. Cerebral Cortex, 13(11), 1257-1269.
39. McHaffie, J., Stanford, T., Stein, B., Coizet, V.,& Redgrave, P. (2005). Subcortical loops through the basal ganglia. Trends in Neurosciences, 28(8), 401-407.
40. McMillen, T., & Holmes, P. (2006). The dynamics of choice among multiple alternatives. Journal of Mathematical Psychology, 50(1), 30-57.
41. Mink, J. (1996). The basal ganglia: Focused selection and inhibition of competing motor programs. Progress in Neurobiology, 50(4), 381-425.
42. Montague, P., Dayan, P., & Sejnowski, T. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16(5), 1936-1947.
43. Nambu, A., Tokuno, H., & Takada, M. (2002). Functional significance of the corticosubthalamo-pallidal "hyperdirect" pathway. Neuroscience Research, 43(2), 111-117.
44. Parent, A., & Hazrati, L. (1995). Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop. Brain Research Reviews, 20(1), 91-127.
45. Platt, M., & Glimcher, P. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400(6741), 233-238.
46. Prescott, T., Redgrave, P.,& Gurney, K. (1999). Layered control architectures in robots and vertebrates. Adaptive Behavior, 7(1), 99-127.
47. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85(2), 59-108.
48. Ratcliff, R., & Frank, M. (2012). Reinforcement-based decision making in corticostriatal circuits: Mutual constraints by neurocomputational and diffusion models. Neural Computation, 24, 1186-2012.
49. Redgrave, P., Prescott, T., & Gurney, K. (1999). The basal ganglia: A vertebrate solution to the selection problem? Neuroscience, 89, 1009-1024.
50. Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M., Lehericy, S., Bergman, H., et al. (2010). Goal-directed and habitual control in the basal ganglia: mplications for Parkinson's disease. Nature Reviews Neuroscience, 11(11), 760-772.
51. Reynolds, J.,Hyland, B.,& Wickens, J. (2001).Acellularmechanism of reward-related learning. Nature, 413(6851), 67-70.
52. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36(2), 241-263.
53. Schultz, W., Dayan, P., & Montague, P. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593-1599.
54. Siegmund, D. (1985). Sequential analysis: Tests and confidence intervals. New York: Springer. Simen, P., Cohen, J., & Holmes, P. (2006). Rapid decision threshold modulation by reward rate in a neural network. Neural Networks, 19(8), 1013-1026.
55. Smith, P., & Ratcliff, R. (2004). Psychology and neurobiology of simple decisions. Trends in Neurosciences, 27(3), 161-168.
56. Smith, P., & Vickers, D. (1988). The accumulator model of two-choice discrimination. Journal of Mathematical Psychology, 32(2), 135-168.
57. Soltani, A., & Wang, X. (2009). Synaptic computation underlying probabilistic inference. Nature Neuroscience, 13(1), 112-119.
58. Stone, M. (1960). Models for choice reaction time. Psychometrika, 25, 251-260.
59. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, UK: Cambridge University Press.
60. Vickers, D. (1970). Evidence for an accumulator model of psychophysical discrimination. Ergonomics, 13, 37-58.
61. Wald, A., & Wolfowitz, J. (1948). Optimum character of the sequential probability ratio test. Annals of Mathematical Statistics, 19(3), 326-339.
62. Wang, X. (2008). Decision making in recurrent neuronal circuits. Neuron, 60(2), 215-34.
63. Yang, T., & Shadlen,M. (2007). Probabilistic reasoning by neurons. Nature, 447(7148), 1075-1080.
64. Zhang, H., & Maloney, L. (2012). Ubiquitous log odds: A common representation of probability and frequencydistortion in perception, action, and cognition. Frontiers in Neuroscience, 6.