Antipsychotic dose modulates behavioral and neural responses to feedback during reinforcement learning in schizophrenia

Cognitive, Affective and Behavioral Neuroscience

Volumn 14, Issue 1, 2014, Pages 189-201

  Insel, Catherine ^a   Reinen, Jenna ^b   Weber, Jochen ^b   Wager, Tor D ^c   Jarskog, L Fredrik ^d   Shohamy, Daphna ^b   Smith, Edward E ^b,e  

^a HARVARD UNIVERSITY   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c UNIVERSITY OF COLORADO   (United States)

^d UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^e NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

Author keywords

Dopamine; Motivation; Reward; Schizophrenia

Indexed keywords

NEUROLEPTIC AGENT;

ADAPTIVE BEHAVIOR; ADULT; BRAIN; BRAIN MAPPING; DOSE RESPONSE; DRUG EFFECTS; FEMALE; HUMAN; MALE; MOTIVATION; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOPHYSIOLOGY; PHYSIOLOGY; PSYCHOLOGICAL RATING SCALE; PSYCHOLOGY; REINFORCEMENT; REWARD; SCHIZOPHRENIA; TASK PERFORMANCE;

ADULT; ANTIPSYCHOTIC AGENTS; BRAIN; BRAIN MAPPING; DOSE-RESPONSE RELATIONSHIP, DRUG; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTIVATION; NEUROPSYCHOLOGICAL TESTS; PSYCHIATRIC STATUS RATING SCALES; REINFORCEMENT (PSYCHOLOGY); REWARD; SCHIZOPHRENIA; SCHIZOPHRENIC PSYCHOLOGY; TASK PERFORMANCE AND ANALYSIS;

EID: 84897541178     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13415-014-0261-3     Document Type: Article

References (62)

1. Abi-Dargham, A. (2003). Probing cortical dopamine function in schizophrenia: what can D1 receptors tell us? World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 2(3), 166-171.
2. Abi-Dargham, A., & Moore, H. (2003). Prefrontal DA transmission at D1 receptors and the pathology of schizophrenia. The Neuroscientist: A Review Journal Bringing Neurobiology, Neurology and Psychiatry, 9(5), 404-416.
3. Addington, D., Addington, J., Maticka-Tyndale, E., & Joyce, J. (1992). Reliability and validity of a depression rating scale for schizophrenics. Schizophrenia Research, 6(3), 201-208.
4. Amtage, J., & Schmidt, W. J. (2003). Context-dependent catalepsy intensification is due to classical conditioning and sensitization. Behavioural Pharmacology, 14(7), 563-567. doi: 10.1097/01.fbp.0000095715.39553.1f
5. Andreasen, N. C., & Olsen, S. (1982). Negative v positive schizophrenia. Definition and validation. Archives of General Psychiatry, 39(7), 789-794.
6. Barch, D. M., & Dowd, E. C. (2010). Goal representations and motivational drive in Schizophrenia: The role of prefrontal-striatal interactions. Schizophrenia Bulletin, 36(5), 919-934. doi: 10.1093/schbul/sbq068
7. Beninger, R. J., Wasserman, J., Zanibbi, K., Charbonneau, D., Mangels, J., & Beninger, B. V. (2003). Typical and atypical antipsychotic medications differentially affect two nondeclarative memory tasks in schizophrenic patients: A double dissociation. Schizophrenia Research, 61(2-3), 281-292.
8. Cazé, R. D., & van der Meer, M. A. A. (2013). Adaptive properties of differential learning rates for positive and negative outcomes. Biological Cybernetics, 107(6), 711-719. doi: 10.1007/s00422-013-0571-5
9. Centonze, D., Usiello, A., Costa, C., Picconi, B., Erbs, E., Bernardi, G., Calabresi, P. (2004). Chronic haloperidol promotes corticostriatal long-term potentiation by targeting dopamine D2L receptors. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 24(38), 8214-8222. doi: 10.1523/JNEUROSCI.1274-04.2004
10. Corlett, P. R., Murray, G. K., Honey, G. D., Aitken, M. R. F., Shanks, D. R., Robbins, T. W., Fletcher, P. C. (2007). Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions. Brain, 130(9), 2387-2400.
11. da Silva Alves, F., Figee, M., van Amelsvoort, T., Veltman, D., & de Haan, L. (2008). The revised dopamine hypothesis of schizophrenia: Evidence from pharmacological MRI studies with atypical antipsychotic medication. Psychopharmacology Bulletin, 41(1), 121-132.
12. Daw, N. D. (2011). Trial-by-trial data analysis using computational models. In Decision Making, Affect, and Learning. Oxford University Press.
13. Daw, N. D., & Doya, K. (2006). The computational neurobiology of learning and reward. Current Opinion in Neurobiology, 16(2), 199-204. doi: 10.1016/j.conb.2006.03.006
14. Delgado, M. R. (2007). Reward-related responses in the human striatum. Annals of the New York Academy of Sciences, 1104, 70-88. doi: 10.1196/annals.1390.002
15. Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008). The role of the striatum in aversive learning and aversive prediction errors. Philosophical Transactions of the Royal Society, B: Biological Sciences, 363(1511), 3787-3800. doi: 10.1098/rstb.2008.0161
16. Delgado, M. R., Locke, H. M., Stenger, V. A., & Fiez, J. A. (2003). Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations. Cognitive, Affective, & Behavioral Neuroscience, 3(1), 27-38.
17. Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of Neurophysiology, 84(6), 3072-3077.
18. Dowd, E. C., & Barch, D. M. (2012). Pavlovian reward prediction and receipt in schizophrenia: Relationship to anhedonia. PloS One, 7(5), e35622. doi: 10.1371/journal.pone.0035622
19. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2002, November). Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition. (SCID-I/NP). Biometrics Research, New York State Psychiatric Institute.
20. Frank, M. J., & O'Reilly, R. C. (2006). A mechanistic account of striatal dopamine function in human cognition: Psychopharmacological studies with cabergoline and haloperidol. Behavioral Neuroscience, 120(3), 497-517. doi: 10.1037/0735-7044.120.3.497
21. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004). By Carrot or by Stick: Cognitive reinforcement learning in Parkinsonism. Science, 306(5703), 1940-1943. doi: 10.1126/science.1102941
22. Gold, J. M., Hahn, B., Strauss, G. P., & Waltz, J. A. (2009). Turning it upside down: Areas of preserved cognitive function in Schizophrenia. Neuropsychology Review, 19(3), 294-311. doi: 10.1007/s11065-009-9098-x
23. Gold, J. M., Waltz, J. A., Matveeva, T. M., Kasanova, Z., Strauss, G. P., Herbener, E. S., Frank, M. J. (2012). Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence. Archives of General Psychiatry, 69(2), 129-138. doi: 10.1001/archgenpsychiatry.2011.1269
24. Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008). Reward processing in schizophrenia: A deficit in the representation of value. Schizophrenia Bulletin, 34(5), 835-847. doi: 10.1093/schbul/sbn068
25. Grace, A. A. (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia. Neuroscience, 41(1), 1-24.
26. Guillin, O., Abi-Dargham, A., & Laruelle, M. (2007). Neurobiology of dopamine in schizophrenia. International Review of Neurobiology, 78, 1-39. doi: 10.1016/S0074-7742(06)78001-1
27. Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Powers, A., Mehta, N., Casey, B. (2014). Adolescent-specific patterns of behavior and neural activity during social reinforcement learning. Cognitive, Affective, & Behavioral Neuroscience, (in press).
28. Juckel, G., Schlagenhauf, F., Koslowski, M., Filonov, D., Wüstenberg, T., Villringer, A., Heinz, A. (2006). Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology, 187(2), 222-228. doi: 10.1007/s00213-006-0405-4
29. Kapur, S., & Mamo, D. (2003). Half a century of antipsychotics and still a central role for dopamine D2 receptors. Progress in Neuro- Psychopharmacology & Biological Psychiatry, 27(7), 1081-1090. doi: 10.1016/j.pnpbp.2003.09.004
30. Kapur, S., & Seeman, P. (2001). Does fast dissociation from the dopamine D2 receptor explain the action of atypical antipsychotics?: A new hypothesis. American Journal of Psychiatry, 158(3), 360-369. doi: 10.1176/appi.ajp.158.3.360
31. Kirsch, P., Ronshausen, S., Mier, D., & Gallhofer, B. (2007). The influence of antipsychotic treatment on brain reward system reactivity in schizophrenia patients. Pharmacopsychiatry, 40(5), 196-198. doi: 10.1055/s-2007-984463
32. Maia, T. V., & Frank, M. J. (2011). From reinforcement learning models to psychiatric and neurological disorders. Nature Neuroscience, 14(2), 154-162. doi: 10.1038/nn.2723
33. Menon, M., Jensen, J., Vitcu, I., Graff-Guerrero, A., Crawley, A., Smith, M. A., & Kapur, S. (2007). Temporal difference modeling of the blood-oxygen level dependent response during aversive conditioning in humans: Effects of dopaminergic modulation. Biological Psychiatry, 62(7), 765-772. doi: 10.1016/j.biopsych.2006.10.020
34. Murray, G. K., Cheng, F., Clark, L., Barnett, J. H., Blackwell, A. D., Fletcher, P. C., Jones, P. B. (2008). Reinforcement and reversal learning in first-episode psychosis. Schizophrenia Bulletin, 34(5), 848-855. doi: 10.1093/schbul/sbn078
35. Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Fletcher, P. C. (2008). Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Molecular psychiatry, 13(3), 239, 267-276. doi: 10.1038/sj.mp.4002058
36. Nikolaus, S., Antke, C., & Müller, H.-W. (2009). In vivo imaging of synaptic function in the central nervous system: II. Mental and affective disorders. Behavioural Brain Research, 204(1), 32-66. doi: 10.1016/j.bbr.2009. 06.009
37. O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38(2), 329-337.
38. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304(5669), 452-454. doi: 10.1126/science.1094285
39. O'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J. (2006). Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron, 49(1), 157-166.
40. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature, 442(7106), 1042-1045. doi: 10.1038/nature05051
41. Reinen, J., Smith, E. E., Insel, C., Kribs, R., Shohamy, D., Wager, T. D., & Jarskog, L. F. (2014). Patients with schizophrenia are impaired when learning in the context of pursuing rewards. Schizophrenia Research, 152(1), 309-310. doi: 10.1016/j.schres.2013.11.012
42. Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010). Testing the reward prediction error hypothesis with an axiomatic model. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 30(40), 13525-13536. doi: 10.1523/JNEUROSCI.1747-10.2010
43. Schlagenhauf, F., Juckel, G., Koslowski, M., Kahnt, T., Knutson, B., Dembler, T., Heinz, A. (2008). Reward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine. Psychopharmacology, 196(4), 673-684. doi: 10.1007/s00213-007-1016-4
44. Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007). Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. The Journal of Neuroscience, 27(47), 12860-12867.
45. Schonberg, T., O'Doherty, J. P., Joel, D., Inzelberg, R., Segev, Y., & Daw, N. D. (2010). Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: Evidence from a model-based fMRI study. NeuroImage, 49(1), 772-781.
46. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80(1), 1-27.
47. Schultz, W. (2001). Reward signaling by dopamine neurons. The Neuroscientist: A Review Journal Bringing Neurobiology, Neurology and Psychiatry, 7(4), 293-302.
48. Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annual Review of Psychology, 57, 87-115. doi: 10.1146/annurev.psych.56. 091103.070229
49. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593-1599.
50. Seeman, P. (1987). Dopamine receptors and the dopamine hypothesis of schizophrenia. Synapse (New York, N.Y.), 1(2), 133-152. doi: 10.1002/syn.890010203
51. Seeman, P. (2010). Dopamine D2 receptors as treatment targets in schizophrenia. Clinical Schizophrenia & Related Psychoses, 4(1), 56-73. doi: 10.3371/CSRP.4.1.5
52. Seymour, B., Daw, N., Dayan, P., Singer, T., & Dolan, R. (2007). Differential encoding of losses and gains in the human striatum. Journal of Neuroscience, 27(18), 4826-4831.
53. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction (Vol. 1). Cambridge Univ Press. Retrieved from http://journals. cambridge.org.ezproxy.cul.columbia.edu/production/action/cjoGetFulltext? fulltextid=34656
54. Ursu, S., Kring, A. M., Gard, M. G., Minzenberg, M. J., Yoon, J. H., Ragland, J. D., Carter, C. S. (2011). Prefrontal cortical deficits and impaired cognition-emotion interactions in schizophrenia. The American journal of psychiatry, 168(3), 276-285. doi: 10.1176/appi.ajp.2010.09081215
55. Wager, T. D., Keller, M. C., Lacey, S. C., & Jonides, J. (2005). Increased sensitivity in neuroimaging analyses using robust regression. NeuroImage, 26(1), 99-113.
56. Waltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011). Altered probabilistic learning and response biases in schizophrenia: Behavioral evidence and neurocomputational modeling. Neuropsychology, 25(1), 86-97. doi: 10.1037/a0020882
57. Waltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Salmeron, B. J., Stein, E. A. (2009). Patients with schizophrenia have a reduced neural re- sponse to both unpredictable and predictable primary reinforcers. Neuropsychopharmacology. 34(6):1567-1577.
58. Waltz, J. A., Schweitzer, J. B., Ross, T. J., Kurup, P. K., Salmeron, B. J., Rose, E. J., Stein, E. A. (2010). Abnormal responses to monetary outcomes in cortex, but not in the basal ganglia, in schizophrenia. Neuropsychopharmacology, 35(12), 2427-2439.
59. Ward, B. D. (2000). Simultaneous inference for fMRI data. AFNI 3dDeconvolve Documentation, Medical College of Wisconsin. Retrieved from http://afni-dev.nimh.nih.gov/pub/dist/doc/manual/AlphaSim.ps
60. Wiecki, T. V., Riedinger, K., von Ameln-Mayerhofer, A., Schmidt, W. J., & Frank, M. J. (2009). A neurocomputational account of catalepsy sensitization induced by D2 receptor blockade in rats: Context dependency, extinction, and renewal. Psychopharmacology, 204(2), 265-277. doi: 10.1007/s00213-008-1457-4
61. Woods, S. W. (2003). Chlorpromazine equivalent doses for the newer atypical antipsychotics. The Journal of Clinical Psychiatry, 64(6), 663-667.
62. Ziauddeen, H., & Murray, G. K. (2010). The relevance of reward pathways for schizophrenia. Current Opinion in Psychiatry, 23(2), 91-96. doi: 10.1097/YCO.0b013e3283366