Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

Nature

Volumn 442, Issue 7106, 2006, Pages 1042-1045

  Pessiglione, Mathias ^a   Seymour, Ben ^a   Flandin, Guillaume ^a   Dolan, Raymond J ^a   Frith, Chris D ^a  

^a WELLCOME TRUST CENTRE FOR NEUROIMAGING   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BIOCOMMUNICATIONS; BRAIN; CONTROLLED DRUG DELIVERY; DECISION MAKING; ERROR ANALYSIS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEUROPHYSIOLOGY; NITROGEN COMPOUNDS;

CORTICO-STRIATAL SYNAPTIC EFFICIENCY; DOPAMINE; HALOPERIDOL; NEUROTRANSMITTERS;

BEHAVIORAL RESEARCH;

BENSERAZIDE PLUS LEVODOPA; DOPAMINE; HALOPERIDOL; LACTOSE; LEVODOPA; NEUROTRANSMITTER;

BRAIN; DRUG; HUMAN BEHAVIOR; LEARNING; THEORETICAL STUDY;

ADAPTATION; ADULT; ARTICLE; BEHAVIOR; BRAIN DEPTH STIMULATION; CONTROLLED STUDY; CORPUS STRIATUM; DRUG ACTIVITY; DRUG EFFECT; DRUG SPECIFICITY; ELECTROENCEPHALOGRAM; ERROR; FEMALE; HUMAN; IMAGE ANALYSIS; LEARNING; MALE; NEUROMODULATION; OUTCOME ASSESSMENT; OXYGEN BLOOD LEVEL; PREDICTIVE VALIDITY; PRIORITY JOURNAL; STATISTICAL PARAMETERS; SYNAPTIC POTENTIAL;

ANIMALIA;

EID: 33748302924     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature05051     Document Type: Article

References (30)

1. Thorndike, E. L. Animal Intelligence: Experimental Studies (Macmillan, New York, 1911).
2. Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997).
3. Wise, R. A. Dopamine, learning and motivation. Nature Rev. Neurosci. 5, 483-494 (2004).
4. Everitt, B. J. et al. Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Ann. NY Acad. Sci. 877, 412-438 (1999).
5. Ikemoto, S. & Panksepp, J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Brain Res. Rev. 31, 6-41 (1999).
6. Hollerman, J. R. & Schultz, W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neurosci. 1, 304-309 (1998).
7. Waelti, P., Dickinson, A. & Schultz, W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43-48 (2001).
8. Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y. & Hikosaka, O. Dopamine neurons can represent context-dependent prediction error. Neuron 41, 269-280 (2004).
9. Bayer, H. M. & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141 (2005).
10. Smith, A. D. & Bolam, J. P. The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones. Trends Neurosci. 13, 259-265 (1990).
11. Calabresi, P. et al. Synaptic transmission in the striatum: from plasticity to neurodegeneration. Prog. Neurobiol. 61, 231-265 (2000).
12. Tremblay, L., Hollerman, J. R. & Schultz, W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80, 964-977 (1998).
13. Frank, M. J., Seeberger, L. C. & O'Reilly, R. C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306, 1940-1943 (2004).
14. Hollerman, J. R., Tremblay, L. & Schultz, W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80, 947-963 (1998).
15. Lauwereyns, J., Watanabe, K., Coe, B. & Hikosaka, O. A neural correlate of response bias in monkey caudate nucleus. Nature 418, 413-417 (2002).
16. Samejima, K., Ueda, Y., Doya, K. & Kimura, M. Representation of action-specific reward values in the striatum. Science 310, 1337-1340 (2005).
17. O'Doherty, J. et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452-454 (2004).
18. Tanaka, S. C. et al. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nature Neurosci. 7, 887-893 (2004).
19. Dickinson, A. Contemporary Animal Learning Theory (Cambridge Univ. Press, Cambridge, 1980).
20. O'Doherty, J. P., Deichmann, R., Critchley, H. D. & Dolan, R. J. Neural responses during anticipation of a primary taste reward. Neuron 33, 815-826 (2002).
21. Knutson, B., Taylor, J., Kaufman, M., Peterson, R. & Glover, G. Distributed neural representation of expected value. J. Neurosci. 25, 4806-4812 (2005).
22. Jueptner, M. & Weiller, C. A review of differences between basal ganglia and cerebellar control of movements as revealed by functional imaging studies. Brain 121, 1437-1449 (1998).
23. Lehericy, S. et al. Motor control in basal ganglia circuits using fMRI and brain atlas approaches. Cereb. Cortex 16, 149-161 (2006).
24. Alexander, G. E., DeLong, M. R. & Strick, P. L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357-381 (1986).
25. Haber, S. N. The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 26, 317-330 (2003).
26. Seymour, B. et al. Temporal difference models describe higher-order learning in humans. Nature 429, 664-667 (2004).
27. Ungless, M. A., Magill, P. J. & Bolam, J. P. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303, 2040-2042 (2004).
28. Salamone, J. D. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 61, 117-133 (1994).
29. Cook, L., Morris, R. W. & Mattis, P. A. Neuropharmacological and behavioral effects of chlorpromazine (thorazine hydrochloride). J. Pharmacol. Exp. Ther. 113, 11-12 (1955).
30. Molina, J. A. et al. Pathologic gambling in Parkinson's disease: a behavioral manifestation of pharmacologic treatment? Mov. Disord. 15, 869-872 (2000).