Optimal decision-making theories

Handbook of Reward and Decision Making

Volumn , Issue , 2009, Pages 373-397

  Bogacz, Rafal ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882486851     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-374620-7.00018-2     Document Type: Chapter

References (63)

1. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 1993, 10:1157-1169.
2. Shadlen M.N., Newsome W.T. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 2001, 86:1916-1936.
3. Roitman J.D., Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 2002, 22:9475-9489.
4. Ditterich J., Mazurek M., Shadlen M.N. Microstimulation of visual cortex affect the speed of perceptual decisions. Nat. Neurosci. 2003, 6:891-898.
5. Schall J.D. Neural basis of deciding, choosing and acting. Nat. Rev. Neurosci. 2001, 2:33-42.
6. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu. Rev. Neurosci. 2007, 30:535-574.
7. Cisek P., Kalaska J.F. Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 2005, 45:801-814.
8. Heekeren H.R., Marrett S., Bandettini P.A., Ungerleider L.G. A general mechanism for perceptual decision-making in the human brain. Nature 2004, 431:859-862.
9. Thompson K.G., Hanes D.P., Bichot N.P., Schall J.D. Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. J. Neurophysiol. 1996, 76:4040-4055.
10. Heekeren H.R., Marrett S., Ungerleider L.G. The neural systems that mediate human perceptual decision making. Nat. Rev. Neurosci. 2008, 9:467-479.
11. Vickers D. Evidence for an accumulator model of psychophysical discrimination. Ergonomics 1970, 13:37-58.
12. Laming D.R.J. Information Theory of Choice Reaction Time 1968, Wiley, New York.
13. Ratcliff R. A theory of memory retrieval. Psychol. Rev. 1978, 83:59-108.
14. Stone M. Models for choice reaction time. Psychometrika 1960, 25:251-260.
15. Bogacz R. Optimal decision-making theories: linking neurobiology with behaviour. Trends Cogn. Sci. 2007, 11:118-125.
16. Gold J.I., Shadlen M.N. Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 2001, 5:10-16.
17. Gold J.I., Shadlen M.N. Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 2002, 36:299-308.
18. Wald A. Sequential Analysis 1947, Wiley, New York.
19. Wald A., Wolfowitz J. Optimum character of the sequential probability ratio test. Ann. Math. Stat. 1948, 19:326-339.
20. Bogacz R., Brown E., Moehlis J., Holmes P., Cohen J.D. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychol. Rev. 2006, 113:700-765.
21. Hanes D.P., Schall J.D. Neural control of voluntary movement initiation. Science 1996, 274:427-430.
22. Mazurek M.E., Roitman J.D., Ditterich J., Shadlen M.N. A role for neural integrators in perceptual decision making. Cereb. Cortex 2003, 13:1257-1269.
23. Usher M., McClelland J.L. The time course of perceptual choice: the leaky, competing accumulator model. Psychol. Rev. 2001, 108:550-592.
24. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
25. Wong K.-F., Wang X.-J. A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 2006, 26:1314-1328.
26. Ratcliff R., Gomez R., McKoon G. A diffusion model account of the lexical decision task. Psychol. Rev. 2004, 111:159-182.
27. Ratcliff R., Rouder J.N. A diffusion model account of masking in two-choice letter identification. J. Exp. Psychol. Hum. Percept. Perform. 2000, 26:127-140.
28. Ratcliff R., Thapar A., McKoon G. A diffusion model analysis of the effects of aging on brightness discrimination. Percept. Psychophys. 2003, 65:523-535.
29. Ratcliff R., Cherian A., Segraves M. A comparison of macaques behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. J. Neurophysiol. 2003, 90:1392-1407.
30. Ratcliff R., Smith P.L. Comparison of sequential sampling models for two-choice reaction time. Psychol. Rev. 2004, 111:333-367.
31. Smith P.L., Ratcliff R. Psychology and neurobiology of simple decisions. Trends Neurosci. 2004, 27:161-168.
32. Hanks T.D., Ditterich J., Shadlen M.N. Microstimulation of macaque area LIP affects decision-making in a motion discrimination task. Nat. Neurosci. 2006, 9:682-689.
33. Ditterich J. Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw. 2006, 19:981-1012.
34. Bogacz R., Gurney K. The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 2007, 19:442-477.
35. Baum C.W., Veeravalli V.V. A sequential procedure for multihypothesis testing. IEEE Trans. Inf. Theory 1994, 40:1996-2007.
36. Redgrave P., Prescott T.J., Gurney K. The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 1999, 89:1009-1023.
37. Chevalier G., Vacher S., Deniau J.M., Desban M. Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spinal/tecto-diencephalic neurons. Brain Res. 1985, 334:215-226.
38. Deniau J.M., Chevalier G. Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus. Brain Res. 1985, 334:227-233.
39. Georgopoulos A.P., DeLong M.R., Crutcher M.D. Relations between parameters of step-tracking movements and single cell discharge in the globus pallidus and subthalamic nucleus of the behaving monkey. J. Neurosci. 1983, 3:1586-1598.
40. Gerardin E., Lehericy S., Pochon J.B., Montcel S.T., Mangin J.F., Poupon F., Agid Y., Le Bihan D., Marsault C. Foot, hand, face and eye representation in human striatum. Cereb. Cortex 2003, 13:162-169.
41. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 1986, 9:357-381.
42. Gurney K., Prescott T.J., Redgrave P. A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol. Cybern. 2001, 84:401-410.
43. Parent A., Hazrati L.N. Anatomical aspects of information processing in primate basal ganglia. Trends Neurosci. 1993, 16:111-116.
44. Parent A., Smith Y. Organization of efferent projections of the subthalamic nucleus in the squirrel monkey as revealed by retrograde labeling methods. Brain Res. 1987, 436:296-310.
45. Frank M.J., Seeberger L.C., O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004, 306:1940-1943.
46. R. Bogacz, optimal decision-making in cortico-basal-ganglia-thalamic loops, forum of European Neuroscience, Geneva, Abstracts, 126.2 (2008).
47. Dragalin V.P., Tertakovsky A.G., Veeravalli V.V. Multihypothesis sequential probability ratio tests - part I: asymptotic optimality. IEEE Trans. Inf. Theory 1999, 45:2448-2461.
48. McMillen T., Holmes P. The dynamics of choice among multiple alternatives. J. Math. Psychol. 2006, 50:30-57.
49. Frank M.J. Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Netw. 2006, 19:1120-1136.
50. Mink J.W. The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 1996, 50:381-425.
51. Frank M.J., Samanta J., Moustafa A.A., Sherman S.J. Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 2007, 318:1309-1312.
52. Jahanshahi M., Ardouin C.M., Brown R.G., Rothwell J.C., Obeso J., Albanese A., Rodriguez-Oroz M.C., Moro E., Benabid A.L., Pollak P., Limousin-Dowsey P. The impact of deep brain stimulation on executive function in Parkinson's disease. Brain 2000, 123(Pt 6):1142-1154.
53. Hallworth N.E., Wilson C.J., Bevan M.D. Apamin-sensitive small conductance calcium-activated potassium channels, through their selective coupling to voltage-gated calcium channels, are critical determinants of the precision, pace, and pattern of action potential generation in rat subthalamic nucleus neurons in vitro. J. Neurosci. 2003, 23:7525-7542.
54. Wilson C.J., Weyrick A., Terman D., Hallworth N.E., Bevan M.D. A model of reverse spike frequency adaptation and repetitive firing of subthalamic nucleus neurons. J. Neurophysiol. 2004, 91:1963-1980.
55. Williams Z.M., Neimat J.S., Cosgrove G.R., Eskandar E.N. Timing and direction selectivity of subthalamic and pallidal neurons in patients with Parkinson disease. Exp. Brain Res. 2005, 162:407-416.
56. Kita H., Kitai S.T. Intracellular study of rat globus pallidus neurons: membrane properties and responses to neostriatal, subthalamic and nigral stimulation. Brain Res. 1991, 564:296-305.
57. Nambu A., Llinas R. Electrophysiology of globus pallidus neurons in vitro. J. Neurophysiol. 1994, 72:1127-1139.
58. Norris D. The Bayesian reader: explaining word recognition as an optimal Bayesian decision process. Psychol. Rev. 2006, 113:327-357.
59. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 1999, 400:233-238.
60. Yang T., Shadlen M.N. Probabilistic reasoning by neurons. Nature 2007, 447:1075-1080.
61. Carpenter R.H., Williams M.L. Neural computation of log likelihood in control of saccadic eye movements. Nature 1995, 377:59-62.
62. Basso M.A., Wurtz R.H. Modulation of neuronal activity in superior colliculus by changes in target probability. J. Neurosci. 1998, 18:7519-7534.
63. Dorris M.C., Glimcher P.W. Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 2004, 44:365-378.