Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia

Biological Psychiatry

Volumn 69, Issue 5, 2011, Pages 424-431

  Strauss, Gregory P ^a   Frank, Michael J ^b   Waltz, James A ^a   Kasanova, Zuzana ^a   Herbener, Ellen S ^c   Gold, James M ^a  

^a MARYLAND PSYCHIATRIC RESEARCH CENTER   (United States)

^b BROWN UNIVERSITY   (United States)

^c UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Computational model; dopamine; negative symptoms; reinforcement learning; reward; schizophrenia

Indexed keywords

ADULT; ANHEDONIA; ARTICLE; BEHAVIOR; CLINICAL ARTICLE; CLINICAL ASSESSMENT; CONTROLLED STUDY; CORRELATION ANALYSIS; DECISION MAKING; DISEASE ASSOCIATION; EXPLORATORY BEHAVIOR; FEMALE; GO LEARNING; HUMAN; LEARNING; MALE; NEGATIVE SYNDROME; NOGO LEARNING; PREDICTIVE VALUE; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SCHIZOPHRENIA;

ADULT; ANTIPSYCHOTIC AGENTS; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; EXPLORATORY BEHAVIOR; FEMALE; HUMANS; LEARNING; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; NEUROPSYCHOLOGICAL TESTS; REACTION TIME; REINFORCEMENT (PSYCHOLOGY); SCHIZOPHRENIA; SCHIZOPHRENIC PSYCHOLOGY; SOCIOECONOMIC FACTORS; TIME PERCEPTION; UNCERTAINTY;

EID: 79951671753     PISSN: 00063223     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.biopsych.2010.10.015     Document Type: Article

References (53)

1. R. Elliott, J.L. Newman, O.A. Longe, and J.F. Deakin Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: A parametric functional magnetic resonance imaging study J Neurosci 23 2003 303 307 (Pubitemid 36050431)
2. M.J. Frank, and E.D. Claus Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal Psychol Rev 113 2006 300 326 (Pubitemid 43815199)
3. J. O'Doherty, M.L. Kringelbach, E.T. Rolls, J. Hornak, and C. Andrews Abstract reward and punishment representations in the human orbitofrontal cortex Nat Neurosci 4 2001 95 102 (Pubitemid 32095532)
4. M.R. Roesch, and C.R. Olson Neuronal activity related to reward value and motivation in primate frontal cortex Science 304 2004 307 310 (Pubitemid 38452186)
5. J.D. Wallis Orbitofrontal cortex and its contribution to decision-making Annu Rev Neurosci 30 2007 31 56 (Pubitemid 47218750)
6. J.D. Wallis, and E.K. Miller Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task Eur J Neurosci 18 2003 2069 2081 (Pubitemid 37372389)
7. M.J. Frank Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism J Cogn Neurosci 17 2005 51 72
8. M.J. Frank, L.C. Seeberger, and R.C. O'Reilly By carrot or by stick: Cognitive reinforcement learning in Parkinsonism Science 306 2004 1940 1943 (Pubitemid 39627859)
9. J.N. Reynolds, B.I. Hyland, and J.R. Wickens A cellular mechanism of reward-related learning Nature 413 2001 67 70 (Pubitemid 32843488)
10. J.R. Wickens, A.J. Begg, and G.W. Arbuthnott Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro Neuroscience 70 1996 1 5 (Pubitemid 126755219)
11. M.X. Cohen, and M.J. Frank Neurocomputational models of basal ganglia function in learning, memory and choice Behav Brain Res 199 2009 141 156
12. N. Pavese, A.H. Evans, Y.F. Tai, G. Hotton, D.J. Brooks, A.J. Lees, and P. Piccini Clinical correlates of levodopa-induced dopamine release in Parkinson disease: A PET study Neurology 67 2006 1612 1617 (Pubitemid 44747932)
13. J. Tedroff, M. Pedersen, S.M. Aquilonius, P. Hartvig, G. Jacobsson, and B. Langstrom Levodopa-induced changes in synaptic dopamine in patients with Parkinson's disease as measured by [11C]raclopride displacement and PET Neurology 46 1996 1430 1436
14. N. Bodi, S. Keri, H. Nagy, A. Moustafa, C.E. Myers, and N. Daw Reward-learning and the novelty-seeking personality: A between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients Brain 132 2009 2385 2395
15. M.J. Frank, A.A. Moustafa, H.M. Haughey, T. Curran, and K.E. Hutchison Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning Proc Natl Acad Sci U S A 104 2007 16311 16316 (Pubitemid 350099356)
16. S. Palminteri, M. Lebreton, Y. Worbe, D. Grabli, A. Hartmann, and M. Pessiglione Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes Proc Natl Acad Sci U S A 106 2009 19179 19184
17. V. Voon, M. Pessiglione, C. Brezing, C. Gallea, H.H. Fernandez, and R.J. Dolan Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors Neuron 65 2010 135 142
18. G.P. Strauss, B.M. Robinson, J.A. Waltz, M.J. Frank, Z. Kasanova, and E.S. Herbener Patients with schizophrenia demonstrate inconsistent preference judgments for affective and Nonaffective stimuli [published online ahead of print May 19] Schizophr Bull 2010
19. J.A. Waltz, M.J. Frank, B.M. Robinson, and J.M. Gold Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction Biol Psychiatry 62 2007 756 764 (Pubitemid 47374640)
20. Waltz JA, FM, Wiecki TV, Gold JM (in press): Altered probabilistic learning and response biases in schizophrenia: Behavioral evidence and neurocomputational modeling. Neuropsychology.
21. H.W. Chase, L. Clark, C.E. Myers, M.A. Gluck, B.J. Sahakian, and E.T. Bullmore The role of the orbitofrontal cortex in human discrimination learning Neuropsychologia 46 2008 1326 1337
22. M. Slifstein, B. Kolachana, E.H. Simpson, P. Tabares, B. Cheng, and M. Duvall COMT genotype predicts cortical-limbic D1 receptor availability measured with [11C]NNC112 and PET Mol Psychiatry 13 2008 821 827 (Pubitemid 352032110)
23. A.A. Moustafa, M.X. Cohen, S.J. Sherman, and M.J. Frank A role for dopamine in temporal decision making and reward maximization in Parkinsonism J Neurosci 28 2008 12294 12304
24. A. Abi-Dargham, O. Mawlawi, I. Lombardo, R. Gil, D. Martinez, and Y. Huang Prefrontal dopamine D1 receptors and working memory in schizophrenia J Neurosci 22 2002 3708 3719 (Pubitemid 37465776)
25. A. Abi-Dargham, and H. Moore Prefrontal DA transmission at D1 receptors and the pathology of schizophrenia Neuroscientist 9 2003 404 416 (Pubitemid 37204344)
26. D.R. Weinberger Implications of normal brain development for the pathogenesis of schizophrenia Arch Gen Psychiatry 44 1987 660 669 (Pubitemid 17099795)
27. T.V. Wiecki, K. Riedinger, A. von Ameln-Mayerhofer, W.J. Schmidt, and M.J. Frank A neurocomputational account of catalepsy sensitization induced by D2 receptor blockade in rats: Context dependency, extinction, and renewal Psychopharmacology 204 2009 265 277
28. M. Farkas, P. Polgar, O. Kelemen, J. Rethelyi, I. Bitter, and C.E. Myers Associative learning in deficit and nondeficit schizophrenia Neuroreport 19 2008 55 58 (Pubitemid 351339620)
29. P. Polgar, M. Farkas, O. Nagy, O. Kelemen, J. Rethelyi, and I. Bitter How to find the way out from four rooms? The learning of "chaining" associations may shed light on the neuropsychology of the deficit syndrome of schizophrenia Schizophr Res 99 2008 200 207 (Pubitemid 351249109)
30. J.D. Cohen, S.M. McClure, and A.J. Yu Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration Philos Trans R Soc Lond B Biol Sci 362 2007 933 942 (Pubitemid 47056820)
31. N.D. Daw, J.P. O'Doherty, P. Dayan, B. Seymour, and R.J. Dolan Cortical substrates for exploratory decisions in humans Nature 441 2006 876 879
32. M.J. Frank, B.B. Doll, J. Oas-Terpstra, and F. Moreno Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation Nat Neurosci 12 2009 1062 1068
33. M.B. First, R.L. Spitzer, M. Gibbon, and J.B.W. Williams Structured Clinical Interview For DSM-IV-TR Axis I Disorders-Patient Edition (SCID-I/P 2/2001 Revision) 2001 Biometrics Research Department, New York State Psychiatric Institute New York
34. N.C. Andreasen The Scale for the Assessment of Negative Symptoms (SANS): Conceptual and theoretical foundations Br J Psychiatry Suppl 7 1989 49 58
35. R.W. Buchanan, D.C. Javitt, S.R. Marder, N.R. Schooler, J.M. Gold, and R.P. McMahon The Cognitive and Negative Symptoms in Schizophrenia Trial (CONSIST): The efficacy of glutamatergic agents for negative symptoms and cognitive impairments Am J Psychiatry 164 2007 1593 1602 (Pubitemid 350069740)
36. S.W. Woods Chlorpromazine equivalent doses for the newer atypical antipsychotics J Clin Psychiatry 64 2003 663 667 (Pubitemid 36750143)
37. J.E. Overall, and D.R. Gorham The brief psychiatric rating scale Psychol Rep 10 1962 799 812
38. K.C. Berridge The debate over dopamine's role in reward: The case for incentive salience Psychopharmacology 191 2007 391 431 (Pubitemid 46355895)
39. Y. Niv, and M. Rivlin-Etzion Parkinson's disease: Fighting the will? J Neurosci 27 2007 11777 11779 (Pubitemid 350072082)
40. J.W. Dalley, K. Laane, D.E. Theobald, H.C. Armstrong, P.R. Corlett, and Y. Chudasama Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens Proc Natl Acad Sci U S A 102 2005 6189 6194 (Pubitemid 40594276)
41. B.J. Everitt, and T.W. Robbins Neural systems of reinforcement for drug addiction: From actions to habits to compulsion Nat Neurosci 8 2005 1481 1489 (Pubitemid 41573659)
42. K. Nakamura, and O. Hikosaka Role of dopamine in the primate caudate nucleus in reward modulation of saccades J Neurosci 26 2006 5360 5369 (Pubitemid 44318388)
43. T.S. Braver, D.M. Barch, and J.D. Cohen Cognition and control in schizophrenia: A computational model of dopamine and prefrontal function Biol Psychiatry 46 1999 312 328 (Pubitemid 29335912)
44. A.J. Smith, M. Li, S. Becker, and S. Kapur Linking animal models of psychosis to computational models of dopamine function Neuropsychopharmacology 32 2007 54 66 (Pubitemid 44967784)
45. M.J. Frank, A. Santamaria, R.C. O'Reilly, and E. Willcutt Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder Neuropsychopharmacology 32 2007 1583 1599 (Pubitemid 46920155)
46. G.K. Murray, P.R. Corlett, L. Clark, M. Pessiglione, A.D. Blackwell, and G. Honey Substantia nigra/ventral tegmental reward prediction error disruption in psychosis Mol Psychiatry 13 2008 67 76
47. Q.J. Huys, and P. Dayan A Bayesian formulation of behavioral control Cognition 113 2009 314 328
48. Kasanova Z, Waltz JA, Strauss GP, Frank MJ, Gold JM: Optimizing versus matching: Response strategy in a probabilistic learning task is associated with negative symptoms of schizophrenia (under review).
49. E.T. Rolls, M. Loh, G. Deco, and G. Winterer Computational models of schizophrenia and dopamine modulation in the prefrontal cortex Nat Rev Neurosci 9 2008 696 709
50. J.C. Dreher, P. Kohn, B. Kolachana, D.R. Weinberger, and K.F. Berman Variation in dopamine genes influences responsivity of the human reward system Proc Natl Acad Sci U S A 106 2009 617 622
51. M.F. Egan, T.E. Goldberg, B.S. Kolachana, J.H. Callicott, C.M. Mazzanti, and R.E. Straub Effect of COMT Val108/158 Met genotype on frontal lobe function and risk for schizophrenia Proc Natl Acad Sci U S A 98 2001 6917 6922 (Pubitemid 32538317)
52. E.D. Boorman, T.E. Behrens, M.W. Woolrich, and M.F. Rushworth How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action Neuron 62 2009 733 743
53. B. Kirkpatrick, G.P. Strauss, L. Nguyen, B.A. Fischer, D.G. Daniel, A. Cienfuegos, and S.R. Marder The Brief Negative Symptom Scale: Psychometric Properties [published online ahead of print June 28] Schizophr Bull 2010