Optimal decision-making theories: linking neurobiology with behaviour

Trends in Cognitive Sciences

Volumn 11, Issue 3, 2007, Pages 118-125

  Bogacz, Rafal ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; ECOLOGY; NEUROLOGY; STATISTICS;

DECISION-MAKING THEORIES; NEUROBIOLOGY; OPTIMAL COMPUTATION;

DECISION MAKING;

ACCURACY; ALGORITHM; BASAL GANGLION; BEHAVIOR; BRAIN CORTEX; BRAIN FUNCTION; COGNITION; DATA ANALYSIS; DECISION MAKING; MOTIVATION; NEUROBIOLOGY; PREDICTION; PSYCHOLOGICAL MODEL; REVIEW; THEORY;

BASAL GANGLIA; BRAIN; CEREBRAL CORTEX; CHOICE BEHAVIOR; DECISION MAKING; DECISION SUPPORT TECHNIQUES; DECISION THEORY; HUMANS; NERVE NET;

EID: 33847103800     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2006.12.006     Document Type: Review

References (69)

1. Laming D.R.J. Information Theory of Choice Reaction Time (1968), Wiley
2. Platt M.L., and Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 400 (1999) 233-238
3. Ratcliff R. A theory of memory retrieval. Psychol. Rev. 83 (1978) 59-108
4. Roitman J.D., and Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 22 (2002) 9475-9489
5. Schall J.D. Neural basis of deciding, choosing and acting. Nat. Rev. Neurosci. 2 (2001) 33-42
6. Shadlen M.N., and Newsome W.T. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 86 (2001) 1916-1936
7. Vickers D. Evidence for an accumulator model of psychophysical discrimination. Ergonomics 13 (1970) 37-58
8. Britten K.H., et al. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 10 (1993) 1157-1169
9. Gold J.I., and Shadlen M.N. Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 5 (2001) 10-16
10. Gold J.I., and Shadlen M.N. Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36 (2002) 299-308
11. Busemeyer J.R., and Townsend J.T. Decision field theory: a dynamic-cognitive approach to decision making in uncertain environment. Psychol. Rev. 100 (1993) 432-459
12. Usher M., and McClelland J.L. The time course of perceptual choice: the leaky, competing accumulator model. Psychol. Rev. 108 (2001) 550-592
13. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36 (2002) 955-968
14. Bogacz R., and Gurney K. The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 19 (2007) 442-477
15. Gurney K., et al. A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol. Cybern. 84 (2001) 401-410
16. Frank M.J. When and when not to use your subthalamic nucleus: lessons from a computational model of the basal ganglia. Neural Netw. 19 (2006) 1120-1136
17. Mazurek M.E., et al. A role for neural integrators in perceptual decision making. Cereb. Cortex 13 (2003) 1257-1269
18. Redgrave P., et al. The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 89 (1999) 1009-1023
19. Wald A., and Wolfowitz J. Optimum character of the sequential probability ratio test. Ann. Math. Stat. 19 (1948) 326-339
20. Stone M. Models for choice reaction time. Psychometrika 25 (1960) 251-260
21. Ratcliff R., and Smith P.L. Comparison of sequential sampling models for two-choice reaction time. Psychol. Rev. 111 (2004) 333-367
22. Ratcliff R., et al. A diffusion model account of the lexical decision task. Psychol. Rev. 111 (2004) 159-182
23. Ratcliff R., and Rouder J.N. A diffusion model account of masking in two-choice letter identification. J. Exp. Psychol. Hum. Percept. Perform. 26 (2000) 127-140
24. Ratcliff R., et al. A diffusion model analysis of the effects of aging on brightness discrimination. Percept. Psychophys. 65 (2003) 523-535
25. Smith P.L., and Ratcliff R. Psychology and neurobiology of simple decisions. Trends Neurosci. 27 (2004) 161-168
26. Ratcliff R., et al. A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. J. Neurophysiol. 90 (2003) 1392-1407
27. Ditterich J., et al. Microstimulation of visual cortex affects the speed of perceptual decisions. Nat. Neurosci. 6 (2003) 891-898
28. Bogacz R., et al. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychol. Rev. 113 (2006) 700-765
29. Ratcliff R. Modeling response signal and response time data. Cognit. Psychol. 53 (2006) 195-237
30. Baum C.W., and Veeravalli V.V. A sequential procedure for multihypothesis testing. IEEE Trans. Inf. Theory 40 (1994) 1996-2007
31. Hikosaka O., et al. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol. Rev. 80 (2000) 953-978
32. Mink J.W. The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 50 (1996) 381-425
33. McHaffie J.G., et al. Subcortical loops through the basal ganglia. Trends Neurosci. 28 (2005) 401-407
34. Alexander G.E., et al. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9 (1986) 357-381
35. Georgopoulos A.P., et al. Relations between parameters of step-tracking movements and single cell discharge in the globus pallidus and subthalamic nucleus of the behaving monkey. J. Neurosci. 3 (1983) 1586-1598
36. Gerardin E., et al. Foot, hand, face and eye representation in human striatum. Cereb. Cortex 13 (2003) 162-169
37. Chevalier G., et al. Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spinal/tecto-diencephalic neurons. Brain Res. 334 (1985) 215-226
38. Deniau J.M., and Chevalier G. Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus. Brain Res. 334 (1985) 227-233
39. Brown J.W., et al. How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades. Neural Netw. 17 (2004) 471-510
40. Gurney K.N., et al. Testing computational hypotheses of brain systems function: a case study with the basal ganglia. Network 15 (2004) 263-290
41. Lo C.C., and Wang X.J. Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time task. Nat. Neurosci. 9 (2006) 956-963
42. Gabbiani F., et al. Multiplicative computation in a visual neuron sensitive to looming. Nature 420 (2002) 320-324
43. Hallworth N.E., et al. Apamin-sensitive small conductance calcium-activated potassium channels, through their selective coupling to voltage-gated calcium channels, are critical determinants of the precision, pace, and pattern of action potential generation in rat subthalamic nucleus neurons in vitro. J. Neurosci. 23 (2003) 7525-7542
44. Wilson C.J., et al. A model of reverse spike frequency adaptation and repetitive firing of subthalamic nucleus neurons. J. Neurophysiol. 91 (2004) 1963-1980
45. Sutton R.S., and Barto A.G. Reinforcement Learning (1998), MIT Press
46. Montague P.R., et al. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16 (1996) 1936-1947
47. O'Doherty J., et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304 (2004) 452-454
48. Schultz W., et al. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
49. Kakade S., and Dayan P. Dopamine: generalization and bonuses. Neural Netw. 15 (2002) 549-559
50. Redgrave P., et al. Is the short-latency dopamine response too short to signal reward error?. Trends Neurosci. 22 (1999) 146-151
51. Frank M.J., et al. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306 (2004) 1940-1943
52. McMillen T., and Holmes P. The dynamics of choice among multiple alternatives. J. Math. Psychol. 50 (2006) 30-57
53. Sugrue L.P., et al. Matching behavior and the representation of value in the parietal cortex. Science 304 (2004) 1782-1787
54. Yang, T. et al. (2005) Incorporating prior probability into decision making in the face of uncertain reliability of evidence. In 2005 Abstract Viewer and Itinerary Planner, Program No. 621.4. Society for Neuroscience online (http://sfn.scholarone.com)
55. Yu A.D., and Dayan P. Inference, attention, and decision in a Bayesian neural architecture. In: Saul L.K., et al. (Ed). Advances in Neural Information Processing Systems (2005), MIT Press 1577-1584
56. Lau B., and Glimcher P.W. Dynamic response-by-response models of matching behavior in rhesus monkeys. J. Exp. Anal. Behav. 84 (2005) 555-579
57. Bogacz, R. et al. Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice. Philos. Trans. R. Soc. Lond. B Biol. Sci. (in press)
58. Busemeyer J.R., and Diederich A. Survey of decision field theory. Math. Soc. Sci. 43 (2002) 345-370
59. Usher M., and McClelland J.L. Loss aversion and inhibition in dynamical models of multialternative choice. Psychol. Rev. 111 (2004) 759-769
60. Brown E., et al. Simple networks that optimize decisions. Int. J. Bifurcat. Chaos 15 (2005) 803-826
61. Frank, M.J. et al. Understanding decision making deficits in neurological conditions: insights from models of natural action selection. Philos. Trans. R. Soc. Lond. B Biol. Sci. (in press)
62. Myung I.J., and Busemeyer J.R. Criterion learning in a deferred decision making task. Am. J. Psychol. 102 (1989) 1-16
63. Simen P., et al. Rapid decision threshold modulation by reward rate in a neural network. Neural Netw. 19 (2006) 1013-1026
64. Wong K.-F., and Wang X.-J. A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 26 (2006) 1314-1328
65. Parent A., and Smith Y. Organization of efferent projections of the subthalamic nucleus in the squirrel monkey as revealed by retrograde labeling methods. Brain Res. 436 (1987) 296-310
66. Holmes P., et al. Optimal decisions: from neural spikes, through stochastic differential equations, to behavior. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences 88 (2005) 2496-2503
67. Maddox W.T., and Bohil C.J. Base-rate and payoff effects in multidimentional perceptual categorization. J. Exp. Psychol. Learn. Mem. Cogn. 24 (1998) 1459-1482
68. Botvinick M.M., et al. Conflict monitoring and cognitive control. Psychol. Rev. 108 (2001) 625-652
69. Yeung N., et al. The neural bases of error detection: conflict monitoring and error-related negativity. Psychol. Rev. 111 (2004) 931-959