Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: evidence from a model-based fMRI study

NeuroImage

Volumn 49, Issue 1, 2010, Pages 772-781

  Schonberg, Tom ^a   O'Doherty, John P ^b   Joel, Daphna ^a   Inzelberg, Rivka ^c   Segev, Yoram ^d   Daw, Nathaniel D ^e  

^a TEL AVIV UNIVERSITY   (Israel)

^b TRINITY COLLEGE DUBLIN   (Ireland)

^c SHEBA MEDICAL CENTER   (Israel)

^d TEL AVIV SOURASKY MEDICAL CENTER   (Israel)

^e NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMANTADINE; LEVODOPA; RASAGILINE; ROPINIROLE; SELEGILINE; TRIHEXYPHENIDYL;

ADULT; ARTICLE; BEHAVIORAL SCIENCE; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DOPAMINERGIC SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; IMAGE ANALYSIS; LEARNING; MALE; MATHEMATICAL MODEL; NERVE DEGENERATION; PARKINSON DISEASE; PREDICTION; PRIORITY JOURNAL; QUESTIONNAIRE; REINFORCEMENT; REWARD; TASK PERFORMANCE;

AGED; DOPAMINE; ECHO-PLANAR IMAGING; EXECUTIVE FUNCTION; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MODELS, NEUROLOGICAL; NEOSTRIATUM; NEUROPSYCHOLOGICAL TESTS; OXYGEN; PARKINSON DISEASE; REINFORCEMENT (PSYCHOLOGY); REWARD; SIGNAL TRANSDUCTION;

EID: 70349967987     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.08.011     Document Type: Article

References (65)

1. Aron A.R., Shohamy D., Clark J., Myers C., Gluck M.A., and Poldrack R.A. Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J. Neurophysiol. 92 (2004) 1144-1152
2. Ballmaier M., Toga A.W., Siddarth P., Blanton R.E., Levitt J.G., Lee M., and Caplan R. Thought disorder and nucleus accumbens in childhood: a structural MRI study. Psychiatry Res. 130 (2004) 43-55
3. Bayer H.M., and Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47 (2005) 129-141
4. Beck A. Beck Depression Inventory (1988), The Psychological Corporation, London
5. Beck A.T., Ward C.H., Mendelson M., Mock J., and Erbaugh J. An inventory for measuring depression. Arch. Gen. Psychiatry 4 (1961) 561-571
6. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl) 191 (2007) 391-431
7. Bódi N., Kéri S., Nagy H., Moustafa A., Myers C.E., Daw N., Dibó G., Takáts A., Bereczki D., and Gluck M.A. Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain (2009) Electronic Publication ahead of print, 2009
8. Braak H., Del Tredici K., Rub U., de Vos R.A., Jansen Steur E.N., and Braak E. Staging of brain pathology related to sporadic Parkinson's disease. Neurobiol. Aging 24 (2003) 197-211
9. Breiter H.C., Gollub R.L., Weisskoff R.M., Kennedy D.N., Makris N., Berke J.D., Goodman J.M., Kantor H.L., Gastfriend D.R., Riorden J.P., Mathew R.T., Rosen B.R., and Hyman S.E. Acute effects of cocaine on human brain activity and emotion. Neuron 19 (1997) 591-611
10. Brooks D.J. Technology insight: imaging neurodegeneration in Parkinson's disease. Nat. Clin. Pract. Neurol. 4 (2008) 267-277
11. Cools R., Barker R.A., Sahakian B.J., and Robbins T.W. Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb. Cortex 11 (2001) 1136-1143
12. Cools R., Lewis S.J., Clark L., Barker R.A., and Robbins T.W. L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 32 (2007) 180-189
13. Dagher A., and Robbins T.W. Personality, addiction, dopamine: insights from Parkinson's disease. Neuron 61 (2009) 502-510
14. D'Ardenne K., McClure S.M., Nystrom L.E., and Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319 (2008) 1264-1267
15. Daw N.D., and Doya K. The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 16 (2006) 199-204
16. Daw N.D., Kakade S., and Dayan P. Opponent interactions between serotonin and dopamine. Neural Netw. 15 (2002) 603-616
17. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., and Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 441 (2006) 876-879
18. Dayan P., and Abbott L.F. Theoretical neuroscience : computational and mathematical modeling of neural systems (2001), Massachusetts Institute of Technology Press, Cambridge, Massachusetts
19. Dayan P., and Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 36 (2002) 285-298
20. Delgado M.R., Nystrom L.E., Fissell C., Noll D.C., and Fiez J.A. Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 84 (2000) 3072-3077
21. Duvernoy H.M. The Human Brain (1999), Springer-Verlag, Vienna
22. Foa E.B., Huppert J.D., Leiberg S., Langner R., Kichic R., Hajcak G., and Salkovskis P.M. The obsessive-compulsive inventory: development and validation of a short version. Psychol. Assess 14 (2002) 485-496
23. Folstein M.F., Folstein S.E., and McHugh P.R. "Mini-mental state." A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12 (1975) 189-198
24. Frank M.J., Seeberger L.C., and O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306 (2004) 1940-1943
25. Gelb D.J., Oliver E., and Gilman S. Diagnostic criteria for Parkinson disease. Arch. Neurol. 56 (1999) 33-39
26. Goto Y., Otani S., and Grace A.A. The Yin and Yang of dopamine release: a new perspective. Neuropharmacology 53 (2007) 583-587
27. Grace A.A. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41 (1991) 1-24
28. Guthrie M., Myers C.E., and Gluck M.A. A neurocomputational model of tonic and phasic dopamine in action selection: a comparison with cognitive deficits in Parkinson's disease. Behav. Brain Res 200 (2009) 48-59
29. Joel D., and Weiner I. The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96 (2000) 451-474
30. Kim H., Shimojo S., and O'Doherty J.P. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. e233 (2006) 4
31. Kish S.J., Shannak K., and Hornykiewicz O. Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. N. Engl. J. Med. 318 (1988) 876-880
32. Klein M.H., Benjamin L.S., Rosenfeld R., Treece C., Husted J., and Greist J.H. The Wisconsin Personality Disorders Inventory: development, reliability and validity. J. Pers. Disord. (1993) 285-303
33. Knutson B., and Gibbs S.E. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berl) 191 (2007) 813-822
34. Knutson B., Westdorp A., Kaiser E., and Hommer D. fMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 12 (2000) 20-27
35. Kobayakawa M., Koyama S., Mimura M., and Kawamura M. Decision making in Parkinson's disease: analysis of behavioral and physiological patterns in the Iowa gambling task. Mov. Disord. 23 (2008) 547-552
36. Kunig G., Leenders K.L., Martin-Solch C., Missimer J., Magyar S., and Schultz W. Reduced reward processing in the brains of Parkinsonian patients. Neuroreport 11 (2000) 3681-3687
37. Mattay V.S., Tessitore A., Callicott J.H., Bertolino A., Goldberg T.E., Chase T.N., Hyde T.M., and Weinberger D.R. Dopaminergic modulation of cortical function in patients with Parkinson's disease. Ann. Neurol. 51 (2002) 156-164
38. McClure S.M., Berns G.S., and Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38 (2003) 339-346
39. McClure S.M., York M.K., and Montague P.R. The neural substrates of reward processing in humans: the modern role of FMRI. Neuroscientist 10 (2004) 260-268
40. Montague P.R., Dayan P., and Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16 (1996) 1936-1947
41. Morris G., Nevet A., Arkadir D., Vaadia E., and Bergman H. Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 9 (2006) 1057-1063
42. Niv Y., and Schoenbaum G. Dialogues on prediction errors. Trends Cogn. Sci. 12 (2008) 265-272
43. O'Doherty J.P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14 (2004) 769-776
44. O'Doherty J.P., Dayan P., Friston K., Critchley H., and Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 38 (2003) 329-337
45. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., and Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304 (2004) 452-454
46. Pagnoni G., Zink C.F., Montague P.R., and Berns G.S. Activity in human ventral striatum locked to errors of reward prediction. Nat. Neurosci. 5 (2002) 97-98
47. Pessiglione M., Seymour B., Flandin G., Dolan R.J., and Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442 (2006) 1042-1045
48. Poldrack R.A., Clark J., Pare-Blagoev E.J., Shohamy D., Creso Moyano J., Myers C., and Gluck M.A. Interactive memory systems in the human brain. Nature 414 (2001) 546-550
49. Price C.J., and Friston K.J. Scanning patients with tasks they can perform. Hum. Brain Mapp. 8 (1999) 102-108
50. Rescorla R.A., and Wagner A.R. A theory of Pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement. In: Black A.H., and Prokasy W.F. (Eds). Classical Conditioning, 2: Current Research and Theory (1972), Appleton Century-Crofts, New York 64-69
51. Robbins T.W. Chemical neuromodulation of frontal-executive functions in humans and other animals. Exp. Brain Res. 133 (2000) 130-138
52. Rodriguez P.F., Aron A.R., and Poldrack R.A. Ventral-striatal/nucleus-accumbens sensitivity to prediction errors during classification learning. Hum. Brain Mapp. 27 (2006) 306-313
53. Schmidt L., d'Arc B.F., Lafargue G., Galanaud D., Czernecki V., Grabli D., Schupbach M., Hartmann A., Levy R., Dubois B., and Pessiglione M. Disconnecting force from money: effects of basal ganglia damage on incentive motivation. Brain 131 (2008) 1303-1310
54. Schonberg T., Daw N.D., Joel D., and O'Doherty J.P. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 27 (2007) 12860-12867
55. Schott B.H., Niehaus L., Wittmann B.C., Schutze H., Seidenbecher C.I., Heinze H.J., and Duzel E. Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. Brain 130 (2007) 2412-2424
56. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80 (1998) 1-27
57. Schultz W. Getting formal with dopamine and reward. Neuron 36 (2002) 241-263
58. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
59. Seymour B., Daw N., Dayan P., Singer T., and Dolan R. Differential encoding of losses and gains in the human striatum. J. Neurosci. 27 (2007) 4826-4831
60. Shohamy D., Myers C.E., Grossman S., Sage J., Gluck M.A., and Poldrack R.A. Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 127 (2004) 851-859
61. Shohamy D., Myers C.E., Grossman S., Sage J., and Gluck M.A. The role of dopamine in cognitive sequence learning: evidence from Parkinson's disease. Behav. Brain Res. 156 (2005) 191-199
62. Sutton R.S., and Barto A.G. Reinforcement Learning MIT (1998), Cambridge, MA
63. Swainson R., SenGupta D., Shetty T., Watkins L.H., Summers B.A., Sahakian B.J., Polkey C.E., Barker R.A., and Robbins T.W. Impaired dimensional selection but intact use of reward feedback during visual discrimination learning in Parkinson's disease. Neuropsychologia 44 (2006) 1290-1304
64. Tom S.M., Fox C.R., Trepel C., and Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 315 (2007) 515-518
65. Zink C.F., Pagnoni G., Martin-Skurski M.E., Chappelow J.C., and Berns G.S. Human striatal responses to monetary reward depend on saliency. Neuron 42 (2004) 509-517