A computational substrate for incentive salience

Trends in Neurosciences

Volumn 26, Issue 8, 2003, Pages 423-428

  McClure, Samuel M ^a   Daw, Nathaniel D ^b   Read Montague, P ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

^b Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

4 AMINOBUTYRIC ACID; DOPAMINE; DOPAMINE RECEPTOR; DOPAMINE RECEPTOR BLOCKING AGENT; DOPAMINE RECEPTOR STIMULATING AGENT; FLUPENTIXOL; PIMOZIDE;

CELL FUNCTION; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; HYPOTHESIS; LEARNING; MODEL; NERVE CELL; NONHUMAN; NUCLEUS ACCUMBENS; PREDICTION; PRIORITY JOURNAL; REVIEW; REWARD; SIGNAL TRANSDUCTION; VENTRAL TEGMENTUM; ALGORITHM; ANIMAL; BIOLOGICAL MODEL; BIOLOGY; BRAIN LEVEL; DECISION MAKING; FORECASTING; MOTIVATION; NERVE CELL PLASTICITY; PHYSIOLOGY; PSYCHOLOGICAL MODEL; RAT;

ALGORITHMS; ANIMALS; BRAIN CHEMISTRY; CHOICE BEHAVIOR; COMPUTATIONAL BIOLOGY; DOPAMINE; FORECASTING; LEARNING; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; MOTIVATION; NEURONAL PLASTICITY; RATS; REWARD;

EID: 0142058800     PISSN: 01662236     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0166-2236(03)00177-2     Document Type: Article

References (27)

1. Wise R.A. Neuroleptics and operant behavior: the anhedonia hypothesis. Behav. Brain Sci. 5:1982;39-87.
2. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28:1998;309-369.
3. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80:1998;1-27.
4. Montague P.R., et al. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16:1996;1936-1947.
5. Ikemoto S., Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31:1999;6-41.
6. Salamone J.D., Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res. 137:2002;3-25.
7. Salamone J.D., et al. Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci. Biobehav. Rev. 21:1997;341-359.
8. Ikemoto S., Panksepp J. Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. Behav. Neurosci. 110:1996;331-345.
9. Redgrave P. Is the short-latency dopamine response too short to signal reward error? Trends Neurosci. 22:1999;146-151.
10. Schultz W., et al. A neural substrate of prediction and reward. Science. 275:1997;1593-1599.
11. Dayan P. Motivated reinforcement learning. Dietterich T., et al. Advances in Neural Information Processing Systems. 14:2002;11-18 MIT Press.
12. Dayan P., Balleine B.W. Reward, motivation, and reinforcement learning. Neuron. 36:2002;285-298.
13. Sutton R.S., Barto A.G. Reinforcement Learning. 1998;MIT Press.
14. Dayan P., Abbott L.F. Theoretical Neuroscience. 2001;MIT Press.
15. Bellman R.E. Dynamic Programming. 1957;Princeton University Press.
16. Garris P.A., et al. Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature. 398:1999;67-69.
17. Kilpatrick M.R., et al. Extracellular dopamine dynamics in rat caudate-putamen during experimenter-delivered and intracranial self-stimulation. Neuroscience. 96:2000;697-706.
18. Berns G.S., et al. Predictability modulates human brain response to reward. J. Neurosci. 21:2001;2793-2798.
19. Pagnoni G., et al. Activity in human ventral striatum locked to errors of reward prediction. Nat. Neurosci. 5:2002;97-98.
20. McClure S.M., et al. Temporal prediction errors in a passive learning task activate human striatum. Neuron. 38:2003;339-346.
21. O'Doherty J., et al. Temporal difference models and reward-related learning in the human brain. Neuron. 38:2003;329-337.
22. Houk J.C., et al. A model of how the basal ganglia generate and use neural signals that predict reinforcement. Houk J.C., et al. Models of Information Processing in the Basal Ganglia. 1995;MIT Press.
23. Montague P.R., et al. Bee foraging in uncertain environments using predictive Hebbian learning. Nature. 377:1995;725-728.
24. Egelman D.M., et al. A computational role for dopamine delivery in human decision-making. J. Cognit. Neurosci. 10:1998;623-630.
25. Wise R.A., et al. Neuroleptic-induced anhedonia in rats: pimozide blocks reward quality of food. Science. 201:1978;262-264.
26. Daw N.D., et al. Opponent interactions between serotonin and dopamine. Neural Netw. 15:2002;603-616.
27. Dickinson A. Actions and habits - the development of behavioral autonomy. Philos. Trans. R. Soc. Lond. B Biol. Sci. 308:1985;67-85.