Brain mechanisms for perceptual and reward-related decision-making

Progress in Neurobiology

Volumn 103, Issue , 2013, Pages 194-213

  Deco, Gustavo ^a   Rolls, Edmund T ^b   Albantakis, Larissa ^a   Romo, Ranulfo ^c  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c INSTITUTO DE FISIOLOGÍA CELULAR   (Mexico)

Author keywords

Attractor network; Confidence; Decision making; Dynamical neuropsychiatry; Noise in the brain; Reward value decision making; Vibrotactile decision making

Indexed keywords

4 AMINOBUTYRIC ACID; N METHYL DEXTRO ASPARTIC ACID RECEPTOR;

ASSOCIATIVE MEMORY; ATTENTION; BEHAVIOR; DECISION MAKING; DIFFUSION; FACILITATION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GABAERGIC SYSTEM; HUMAN; LONG TERM MEMORY; NERVE CELL INHIBITION; NERVE CELL NETWORK; NEUROPSYCHIATRY; NONHUMAN; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; OBSESSIVE COMPULSIVE DISORDER; OSCILLATION; PERCEPTION; PERCEPTIVE DISCRIMINATION; PHENOMENOLOGY; POSITIVE FEEDBACK; PREFRONTAL CORTEX; PREMOTOR CORTEX; PRIORITY JOURNAL; PROBABILITY; REACTION TIME; REFRACTORY PERIOD; REVIEW; REWARD; SCHIZOPHRENIA; SENSORY STIMULATION; SHORT TERM MEMORY; SIGNAL NOISE RATIO; STATISTICAL MODEL; SYNAPSE; SYNAPTIC EFFICACY; SYNAPTIC TRANSMISSION; TACTILE DISCRIMINATION; WHITE NOISE;

ANIMALS; BRAIN; DECISION MAKING; HUMANS; MODELS, NEUROLOGICAL; NEURONS; PERCEPTION; REWARD;

EID: 84875952764     PISSN: 03010082     EISSN: 18735118     Source Type: Journal    
DOI: 10.1016/j.pneurobio.2012.01.010     Document Type: Review

References (117)

1. Albantakis L., Deco G. The encoding of alternatives in multiple-choice decision making. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:10308-10313.
2. Albantakis L., Deco G. Changes of mind in an attractor network of decision-making. PLoS Comput. Biol. 2011, 7:e1002086.
3. Amit D.J., Brunel N. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex 1997, 7:237-252.
4. Beck J.M., Ma W.J., Kiani R., Hanks T., Churchland A.K., Roitman J., Shadlen M.N., Latham P.E., Pouget A. Probabilistic population codes for Bayesian decision making. Neuron 2008, 60:1142-1152.
5. Bogacz R., Brown E., Moehlis J., Holmes P., Cohen J.D. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol. Rev. 2006, 113:700-765.
6. Bogacz R., Gurney K. The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 2007, 19:442-477.
7. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J. Neurosci. 1992, 12:4745-4765.
8. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 1993, 10:1157-1169.
9. Brown S.D., Heathcote A. The simplest complete model of choice response time: linear ballistic accumulation. Cogn. Psychol. 2008, 57:153-178.
10. Brunel N., Wang X.J. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J. Comput. Neurosci. 2001, 11:63-85.
11. Buehlmann A., Deco G. Optimal information transfer in the cortex through synchronization. PLoS Comput. Biol. 2010, 6:e1000934.
12. Busemeyer J.R., Townsend J.T. Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol. Rev. 1993, 100:432-459.
13. Buzsaki G. Rhythms of the Brain 2006, Oxford University Press, New York.
14. Churchland A.K., Kiani R., Chaudhuri R., Wang X.J., Pouget A., Shadlen M.N. Variance as a signature of neural computations during decision making. Neuron 2011, 69:818-831.
15. Churchland A.K., Kiani R., Shadlen M.N. Decision-making with multiple alternatives. Nat. Neurosci. 2008, 11:693-702.
16. Churchland M.M., Yu B.M., Cunningham J.P., Sugrue L.P., Cohen M.R., Corrado G.S., Newsome W.T., Clark A.M., Hosseini P., Scott B.B., Bradley D.C., Smith M.A., Kohn A., Movshon J.A., Armstrong K.M., Moore T., Chang S.W., Snyder L.H., Lisberger S.G., Priebe N.J., Finn I.M., Ferster D., Ryu S.I., Santhanam G., Sahani M., Shenoy K.V. Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat. Neurosci. 2010, 13:369-378.
17. Cisek P., Puskas G.A., El-Murr S. Decisions in changing conditions: the urgency-gating model. J. Neurosci. 2009, 29:11560-11571.
18. Deco G., Rolls E.T. Decision-making and Weber's Law: a neurophysiological model. Eur. J. Neurosci. 2006, 24:901-916.
19. Deco G., Rolls E.T., Romo R. Synaptic dynamics and decision-making. Proc. Natl. Acad. Sci. U.S.A. 2010, 107:7545-7549.
20. Deco G., Scarano L., Soto-Faraco S. Weber's law in decision making: integrating behavioral data in humans with a neurophysiological model. J. Neurosci. 2007, 27:11192-11200.
21. Ditterich J. Evidence for time-variant decision making. Eur. J. Neurosci. 2006, 24:3628-3641.
22. Ditterich J. Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw. 2006, 19:981-1012.
23. Ditterich J. A comparison between mechanisms of multi-alternative perceptual decision making: ability to explain human behavior, predictions for neurophysiology, and relationship with decision theory. Front. Neurosci. 2010, 4:184.
24. Dragalin V.P., Tartakovsky A.G., Veeravalli V.V. Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality. IEEE Trans. Inf. Theory 1999, 45:2448-2461.
25. Fries P. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn. Sci. 2005, 9:474-480.
26. Fries P. Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu. Rev. Neurosci. 2009, 32:209-224.
27. Furman M., Wang X.J. Similarity effect and optimal control of multiple-choice decision making. Neuron 2008, 60:1153-1168.
28. Gardiner C.W. Handbook of Stochastic Methods 1985, New York, Springer.
29. Gnadt J.W., Andersen R.A. Memory related motor planning activity in posterior parietal cortex of macaque. Experimentelle Hirnforschung[[n1]]Exp. brain Res. 1988, 70:216-220.
30. Gold J.I., Shadlen M.N. Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 2001, 5:10-16.
31. Gold J.I., Shadlen M.N. Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 2002, 36:299-308.
32. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu. Rev. Neurosci. 2007, 30:535-574.
33. Grabenhorst F., Rolls E.T. Value, pleasure, and choice in the ventral prefrontal cortex. Trends Cogn. Sci. 2011, 15:56-67.
34. Grabenhorst F., Rolls E.T., Parris B.A. From affective value to decision-making in the prefrontal cortex. Eur. J. Neurosci. 2008, 28:1930-1939.
35. Green D., Swets J. Signal Detection Theory and Psychophysics 1966, New York, Wiley.
36. Heekeren H.R., Marrett S., Bandettini P.A., Ungerleider L.G. A general mechanism for perceptual decision-making in the human brain. Nature 2004, 431:859-862.
37. Hempel C.M., Hartman K.H., Wang X.J., Turrigiano G.G., Nelson S.B. Multiple forms of short-term plasticity at excitatory synapses in rat medial prefrontal cortex. J. Neurophysiol. 2000, 83:3031-3041.
38. Hernandez A., Nacher V., Luna R., Zainos A., Lemus L., Alvarez M., Vazquez Y., Camarillo L., Romo R. Decoding a perceptual decision process across cortex. Neuron 2010, 66:300-314.
39. Hick W.E. On the rate of gain of information. Q. J. Exp. Psychol. 1952, 4:11-26.
40. Huk A.C., Shadlen M.N. Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. J. Neurosci. 2005, 25:10420-10436.
41. Insabato A., Pannunzi M., Rolls E.T., Deco G. Confidence-related decision-making. J. Neurophysiol. 2010, 104:539-547.
42. Jezek K., Henriksen E.J., Treves A., Moser E.I., Moser M.-B. Theta-paced flickering between place-cell maps in the hippocampus. Nature 2011, 278:246-249.
43. Jonsson F.U., Olsson H., Olsson M.J. Odor emotionality affects the confidence in odor naming. Chem. Senses 2005, 30:29-35.
44. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
45. Kiani R., Shadlen M.N. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 2009, 324:759-764.
46. Kim J.N., Shadlen M.N. Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat. Neurosci. 1999, 2:176-185.
47. Laming D. Information Theory of Choice Reaction Time 1968, Chichester, Wiley.
48. Leite F.P., Ratcliff R. Modeling reaction time and accuracy of multiple-alternative decisions. Atten. Percept. Psychophys. 2010, 72:246-273.
49. Lemus L., Hernandez A., Luna R., Zainos A., Nacher V., Romo R. Neural correlates of a postponed decision report. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:17174-17179.
50. Lo C.C., Wang X.J. Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat. Neurosci. 2006, 9:956-963.
51. Loh M., Rolls E.T., Deco G. A dynamical systems hypothesis of schizophrenia. PLoS Comput. Biol. 2007, 3:e228. doi:10.1371/journal.pcbi.0030228.
52. Loh M., Rolls E.T., Deco G. Statistical fluctuations in attractor networks related to schizophrenia. Pharmacopsychiatry 2007, 40:S78-S84.
53. Luce R.D. Response Times: Their Role in Inferring Elementary Mental Organization 1991, Oxford University Press, New York.
54. Lund J.S., Angelucci A., Bressloff P.C. Anatomical substrates for functional columns in macaque monkey primary visual cortex. Cereb. Cortex 2003, 13:15-24.
55. Ma W.J., Beck J.M., Latham P.E., Pouget A. Bayesian inference with probabilistic population codes. Nat. Neurosci. 2006, 9:1432-1438.
56. Ma W.J., Beck J.M., Pouget A. Spiking networks for Bayesian inference and choice. Curr. Opin. Neurobiol. 2008, 18:217-222.
57. Marti D., Deco G., Mattia M., Gigante G., Del Giudice P. A fluctuation-driven mechanism for slow decision processes in reverberant networks. PLoS ONE 2008, 3:e2534.
58. Martinez-Garcia M., Rolls E.T., Deco G., Romo R. Neural and computational mechanisms of postponed decisions. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:11626-11631.
59. Masquelier T., Albantakis L., Deco G. The timing of vision-how neural processing links to different temporal dynamics. Front. Psychol. 2011, 2:151.
60. Mazurek M.E., Roitman J.D., Ditterich J., Shadlen M.N. A role for neural integrators in perceptual decision making. Cereb. Cortex 2003, 13:1257-1269.
61. McMillen T., Holmes P. The dynamics of choice among multiple alternatives. J. Math. Psychol. 2006, 50:30-57.
62. Mongillo G., Barak O., Tsodyks M. Synaptic theory of working memory. Science 2008, 319:1543-1546.
63. Neyman J., Pearson E.S. On the problem of the most efficient tests of statistical hypotheses. Phil. Trans. R. Soc. 1933, 231:289-337.
64. Niwa M., Ditterich J. Perceptual decisions between multiple directions of visual motion. J. Neurosci. 2008, 28:4435-4445.
65. Opris I., Bruce C.J. Neural circuitry of judgment and decision mechanisms. Brain Res. 2005, 48:509-526.
66. Palmer J., Huk A.C., Shadlen M.N. The effect of stimulus strength on the speed and accuracy of a perceptual decision. J. Vis. 2005, 5:376-404.
67. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 1999, 400:233-238.
68. Pleskac T.J., Busemeyer J.R. Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. Psychol. Rev. 2010, 117:864-901.
69. Purcell B.A., Heitz R.P., Cohen J.Y., Schall J.D., Logan G.D., Palmeri T.J. Neurally constrained modeling of perceptual decision making. Psychol. Rev. 2010, 117:1113-1143.
70. Ratcliff R. Theory of memory retrieval. Psychol. Rev. 1978, 85:59-108.
71. Ratcliff R., Cherian A., Segraves M. A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. J. Neurophysiol. 2003, 90:1392-1407.
72. Ratcliff R., McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 2008, 20:873-922.
73. Ratcliff R., Rouder J.N. Modeling response times for two-choice decisions. Psychol. Sci. 1998, 9:347-356.
74. Ratcliff R., Smith P.L. A comparison of sequential sampling models for two-choice reaction time. Psychol. Rev. 2004, 111:333-367.
75. Reddi B.A., Carpenter R.H. The influence of urgency on decision time. Nat. Neurosci. 2000, 3:827-830.
76. Renart A., Brunel N., Wang X.-J. Mean field theory of irregularly spiking neuronal populations and working memory in recurrent cortical networks. Computational Neuroscience: A Comprehensive Approach 2003, 431-490. Chapman and Hall, Boca-Raton. J. Feng (Ed.).
77. Roitman J.D., Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 2002, 22:9475-9489.
78. Rolls E.T. Emotion Explained 2005, Oxford University Press, Oxford.
79. Rolls E.T. Memory, Attention, and Decision-Making: A Unifying Computational Neuroscience Approach 2008, Oxford University Press, Oxford.
80. Rolls E.T. Consciousness, decision-making, and neural computation. Perception-Action Cycle: Models, Algorithms and Systems. 2011, 287-333. Springer, Berlin. V. Cutsuridis, A. Hussain, J.G. Taylor (Eds.).
81. Rolls E.T. Glutamate, obsessive-compulsive disorder, schizophrenia, and the stability of cortical attractor neuronal networks. Pharmacol. Biochem. Behav. 2012, 100:736-751.
82. Rolls E.T. Neuroculture. On the Implications of Brain Science 2012, Oxford University Press, Oxford.
83. Rolls E.T., Deco G. The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function 2010, Oxford University Press, Oxford.
84. Rolls E.T., Deco G. A computational neuroscience approach to schizophrenia and its onset. Neurosci. Biobehav. Rev. 2011, 35:1644-1653.
85. Rolls E.T., Deco G. Prediction of decisions from noise in the brain before the evidence is provided. Front. Neurosci. 2011, 5:33.
86. Rolls E.T., Grabenhorst F., Deco G. Choice, difficulty, and confidence in the brain. Neuroimage 2010, 53:694-706.
87. Rolls E.T., Grabenhorst F., Deco G. Decision-making, errors, and confidence in the brain. J. Neurophysiol. 2010, 104:2359-2374.
88. Rolls E.T., Loh M., Deco G. An attractor hypothesis of obsessive-compulsive disorder. Eur. J. Neurosci. 2008, 28:782-793.
89. Rolls E.T., Loh M., Deco G., Winterer G. Computational models of schizophrenia and dopamine modulation in the prefrontal cortex. Nat. Rev. Neurosci. 2008, 9:696-709.
90. Rolls E.T., Treves A. Neural Networks and Brain Function 1998, Oxford University Press, Oxford.
91. Rolls E.T., Treves A. The neuronal encoding of information in the brain. Prog. Neurobiol. 2011, 95:448-490.
92. Rolls E.T., Webb T.J. Cortical attractor network dynamics with diluted connectivity. Brain Res. 2012, 1434:212-225.
93. Rolls E.T., Webb T.J., Deco G. Communication before coherence. Eur. J. Neurosci. 2012, in revision.
94. Romo R., Hernandez A., Zainos A. Neuronal correlates of a perceptual decision in ventral premotor cortex. Neuron 2004, 41:165-173.
95. Romo R., Salinas E. Flutter discrimination: neural codes, perception, memory and decision making. Nat. Rev. Neurosci. 2003, 4:203-218.
96. Roxin A., Ledberg A. Neurobiological models of two-choice decision making can be reduced to a one-dimensional nonlinear diffusion equation. PLoS Comput. Biol. 2008, 4:e1000046.
97. Shadlen M.N., Newsome W.T. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 2001, 86:1916-1936.
98. Smerieri A., Rolls E.T., Feng J. Decision reaction time, slow inhibition, and theta rhythm. J. Neurosci. 2010, 30:14173-14181.
99. Stone M. Models for choice-reaction time. Psychometrika 1960, 25:251-260.
100. Tanner W.P., Swets J.A. A decision-making theory of visual detection. Psychol. Rev. 1954, 61:401-409.
101. Townsend J.T., Ashby F.G. The Stochastic Modeling of Elementary Psychological Processes 1983, Cambridge University Press, Cambridge.
102. Tuckwell H. Introduction to Theoretical Neurobiology 1988, Cambridge University Press, Cambridge.
103. Usher M., McClelland J.L. The time course of perceptual choice: the leaky, competing accumulator model. Psychol. Rev. 2001, 108:550-592.
104. Vandekerckhove J., Tuerlinckx F. Fitting the Ratcliff diffusion model to experimental data. Psychon. Bull. Rev. 2007, 14:1011-1026.
105. Vickers D. Evidence for an accumulator model of psychophysical discrimination. Ergonomics 1970, 13:37-58.
106. Vickers D. Decision Processes in Visual Perception 1979, Academic Press, New York.
107. Vickers D., Packer J. Effects of alternating set for speed or accuracy on response time, accuracy and confidence in a unidimensional discrimination task. Acta Psychol. (Amst.) 1982, 50:179-197.
108. Wald A. Sequential Analysis 1947, New York, Wiley.
109. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
110. Wang X.J. Decision making in recurrent neuronal circuits. Neuron 2008, 60:215-234.
111. Wang X.J. Neurophysiological and computational principles of cortical rhythms in cognition. Physiol. Rev. 2010, 90:1195-1268.
112. Wang Y., Markram H., Goodman P.H., Berger T.K., Ma J., Goldman-Rakic P.S. Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nat. Neurosci. 2006, 9:534-542.
113. Webb T., Rolls E.T., Deco G., Feng J. Noise in attractor networks in the brain produced by graded firing rate representations. PLoS ONE 2011, 6:e23630.
114. Wong K.F., Huk A.C. Temporal dynamics underlying perceptual decision making: Insights from the Interplay between an attractor model and parietal neurophysiology. Front. Neurosci. 2008, 2:245-254.
115. Wong K.F., Huk A.C., Shadlen M.N., Wang X.J. Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Front. Comput. Neurosci. 2007, 1:6.
116. Wong K.F., Wang X.J. A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 2006, 26:1314-1328.
117. Zucker R.S., Regehr W.G. Short-term synaptic plasticity. Annu. Rev. Physiol. 2002, 64:355-405.