Negative symptoms and the failure to represent the expected reward value of actions: Behavioral and computational modeling evidence

Archives of General Psychiatry

Volumn 69, Issue 2, 2012, Pages 129-138

  Gold, James M ^a   Waltz, James A ^a   Matveeva, Tatyana M ^a   Kasanova, Zuzana ^a   Strauss, Gregory P ^a   Herbener, Ellen S ^b   Collins, Anne G E ^c   Frank, Michael J ^c  

^a MARYLAND PSYCHIATRIC RESEARCH CENTER   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^c BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NEUROLEPTIC AGENT;

ARTICLE; AVOIDANCE BEHAVIOR; CLINICAL ARTICLE; CONTROLLED STUDY; DECISION MAKING; FEMALE; HUMAN; LEARNING; LEARNING DISORDER; LEARNING TEST; MALE; NEGATIVE SYNDROME; NEUROPSYCHOLOGICAL TEST; OUTCOME ASSESSMENT; PSYCHOLOGICAL MODEL; REINFORCEMENT; REWARD; SCHIZOPHRENIA; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; TASK PERFORMANCE; TRAINING;

ADULT; AVOIDANCE LEARNING; CASE-CONTROL STUDIES; CHOICE BEHAVIOR; FEMALE; GENERALIZATION (PSYCHOLOGY); HUMANS; MALE; MODELS, PSYCHOLOGICAL; MODELS, STATISTICAL; NEUROPSYCHOLOGICAL TESTS; PSYCHOTIC DISORDERS; REINFORCEMENT (PSYCHOLOGY); REWARD; SCHIZOPHRENIC PSYCHOLOGY;

EID: 84856723289     PISSN: 0003990X     EISSN: 15383636     Source Type: Journal    
DOI: 10.1001/archgenpsychiatry.2011.1269     Document Type: Article

References (58)

1. Barch DM, Dowd EC. Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions. Schizophr Bull. 2010;36(5):919-934.
2. Gold JM, Waltz JA, Prentice KJ, Morris SE, Heerey EA. Reward processing in schizophrenia: a deficit in the representation of value. Schizophr Bull. 2008;34(5):835-847.
3. Kapur S. Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry. 2003;160(1):13-23. (Pubitemid 36042420)
4. Heinz A, Schlagenhauf F. Dopaminergic dysfunction in schizophrenia: salience attribution revisited. Schizophr Bull. 2010;36(3):472-485.
5. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol. 1998;80(1):1-27. (Pubitemid 28326237)
6. Schultz W. Getting formal with dopamine and reward. Neuron. 2002;36(2):241-263. (Pubitemid 35217890)
7. Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci. 1996;16(5):1936-1947. (Pubitemid 26145969)
8. Montague PR, Hyman SE, Cohen JD. Computational roles for dopamine in behavioural control. Nature. 2004;431(7010):760-767. (Pubitemid 39434064)
9. Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press; 1998.
10. Dayan P, Daw ND. Decision theory, reinforcement learning, and the brain. Cogn Affect Behav Neurosci. 2008;8(4):429-453.
11. Maia TV. Reinforcement learning, conditioning, and the brain: successes and challenges. Cogn Affect Behav Neurosci. 2009;9(4):343-364.
12. Cohen MX, Frank MJ. Neurocomputational models of basal ganglia function in learning, memory and choice. Behav Brain Res. 2009;199(1):141-156.
13. Davis KL, Kahn RS, Ko G, Davidson M. Dopamine in schizophrenia: a review and reconceptualization. Am J Psychiatry. 1991;148(11):1474-1486.
14. Laruelle M, Abi-Dargham A. Dopamine as the wind of the psychotic fire: new evidence from brain imaging studies. J Psychopharmacol. 1999;13(4):358-371. (Pubitemid 30055180)
15. Carlsson A. Does dopamine play a role in schizophrenia? Psychol Med. 1977;7 (4):583-597. (Pubitemid 8232990)
16. Kapur S, Mamo D. Half a century of antipsychotics and still a central role for dopamine D2 receptors. Prog Neuropsychopharmacol Biol Psychiatry. 2003;27(7): 1081-1090. (Pubitemid 37464954)
17. Kapur S, Mizrahi R, Li M. From dopamine to salience to psychosis - linking biology, pharmacology and phenomenology of psychosis. Schizophr Res. 2005;79(1):59-68. (Pubitemid 41362593)
18. Murray GK, Corlett PR, Clark L, Pessiglione M, Blackwell AD, Honey G, Jones PB, Bullmore ET, Robbins TW, Fletcher PC. Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol Psychiatry. 2008;13(3):239-, 267-276.
19. Corlett PR, Murray GK, Honey GD, Aitken MR, Shanks DR, Robbins TW, Bullmore ET, Dickinson A, Fletcher PC. Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions. Brain. 2007;130(pt 9): 2387-2400. (Pubitemid 47327635)
20. Waltz JA, Frank MJ, Robinson BM, Gold JM. Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatalcortical dysfunction. Biol Psychiatry. 2007;62(7):756-764. (Pubitemid 47374640)
21. Haber SN, Kim KS, Mailly P, Calzavara R. Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J Neurosci. 2006;26(32):8368-8376. (Pubitemid 44309851)
22. Schoenbaum G, Roesch M. Orbitofrontal cortex, associative learning, and expectancies. Neuron. 2005;47(5):633-636. (Pubitemid 41208002)
23. Frank MJ, Claus ED. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev. 2006;113(2):300-326. (Pubitemid 43815199)
24. van der Meer MA, Johnson A, Schmitzer-Torbert NC, Redish AD. Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron. 2010;67(1):25-32.
25. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science. 2004;304(5669):452-454. (Pubitemid 38495943)
26. Furuyashiki T, Gallagher M. Neural encoding in the orbitofrontal cortex related to goal-directed behavior. Ann N Y Acad Sci. 2007;1121:193-215.
27. Plassmann H, O'Doherty JP, Rangel A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J Neurosci. 2010;30(32):10799-10808.
28. Roesch MR, Olson CR. Neuronal activity related to anticipated reward in frontal cortex: does it represent value or reflect motivation? Ann N Y Acad Sci. 2007;1121:431-446.
29. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006;442(7106):1042-1045. (Pubitemid 44330261)
30. Kim H, Shimojo S, O'Doherty JP. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 2006;4(8):e233. Accessed October 31, 2011.
31. Holroyd CB, Larsen JT, Cohen JD. Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology. 2004;41(2):245-253. (Pubitemid 38524096)
32. Nieuwenhuis S, Heslenfeld DJ, von Geusau NJ, Mars RB, Holroyd CB, Yeung N. Activity in human reward-sensitive brain areas is strongly context dependent. Neuroimage. 2005;25(4):1302-1309.
33. Moutoussis M, Bentall RP, Williams J, Dayan P. A temporal difference account of avoidance learning. Network. 2008;19(2):137-160.
34. Maia TV. Two-factor theory, the actor-critic model, and conditioned avoidance. Learn Behav. 2010;38(1):50-67.
35. Beninger RJ, Mason ST, Phillips AG, Fibiger HC. The use of conditioned suppression to evaluate the nature of neuroleptic-induced avoidance deficits. J Pharmacol Exp Ther. 1980;213(3):623-627. (Pubitemid 10085171)
36. Frank MJ, Seeberger LC, O'reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science. 2004;306(5703):1940-1943. (Pubitemid 39627859)
37. Strauss GP, Frank MJ, Waltz JA, Kasanova Z, Herbener ES, Gold JM. Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biol Psychiatry. 2011;69(5):424-431.
38. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington, DC: American Psychiatric Association; 1994.
39. First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV-Axis I Disorders (SCID-I). Washington, DC: American Psychiatric Press; 1997.
40. Pfohl B, Blum N, Zimmerman M. Structured Interview for DSM-IV Personality (SID-P). Washington, DC: American Psychiatric Press; 1997.
41. Andreasen NC. The Scale for the Assessment of Negative Symptoms (SANS). Iowa City: University of Iowa; 1984.
42. Blanchard JJ, Cohen AS. The structure of negative symptoms within schizophrenia: implications for assessment. Schizophr Bull. 2006;32(2):238-245.
43. Sayers SL, Curran PJ, Mueser KT. Factor structure and construct validity of the Scale for the Assessment of Negative Symptoms. Psychol Assess. 1996;8(3):269-280. (Pubitemid 26341342)
44. Overall JE, Gorman DR. The Brief Psychiatric Rating Scale. Psychol Rep. 1962;10:799-812.
45. McMahon RP, Kelly DL, Kreyenbuhl J, Kirkpatrick B, Love RC, Conley RR. Novel factor-based symptom scores in treatment resistant schizophrenia: implications for clinical trials. Neuropsychopharmacology. 2002;26(4):537-545. (Pubitemid 34261003)
46. Wilkinson GS, Robertson GJ. Wide Range Achievement Test 4: Professional Manual. Lutz, FL: Psychological Assessment Resources Inc; 2006.
47. Wechsler D. Wechsler Test of Adult Reading (WTAR). San Antonio, TX: Psychological Corporation; 2001.
48. Wechsler D. Wechsler Abbreviated Scale of Intelligence (WASI). San Antonio, TX: Psychological Corporation; 1999.
49. Nuechterlein KH, Green MF. MATRICS Consensus Cognitive Battery Manual. Los Angeles, CA: MATRICS Assessment Inc; 2006.
50. Expert Consensus Panel for Optimizing Pharmacologic Treatment of Psychotic Disorders. The expert consensus guideline series. Optimizing pharmacologic treatment of psychotic disorders. J Clin Psychiatry. 2003;64(suppl 12):2-100.
51. Maia TV, Frank MJ. From reinforcement learning models to psychiatric and neurological disorders. Nat Neurosci. 2011;14(2):154-162.
52. Schoenbaum G, Esber GR. How do you (estimate you will) like them apples? integration as a defining trait of orbitofrontal function. Curr Opin Neurobiol. 2010;20(2):205-211.
53. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci. 2009;10(12):885-892.
54. Balleine BW, O'Doherty JP. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology. 2010;35(1):48-69.
55. Frank MJ, Doll BB, Oas-Terpstra J, Moreno F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci. 2009;12(8):1062-1068.
56. Badre D, Doll BB, Long N, Frank MJ. Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron. In press.
57. Waltz JA, Schweitzer JB, Gold JM, Kurup PK, Ross TJ, Salmeron BJ, Rose EJ, McClure SM, Stein EA. Patients with schizophrenia have a reduced neural response to both unpredictable and predictable primary reinforcers. Neuropsychopharmacology. 2009;34(6):1567-1577.
58. Schlagenhauf F, Sterzer P, Schmack K, Ballmaier M, Rapp M, Wrase J, Juckel G, Gallinat J, Heinz A. Reward feedback alterations in unmedicated schizophrenia patients: relevance for delusions. Biol Psychiatry. 2009;65(12):1032-1039.