Striatal dysfunction during reversal learning in unmedicated schizophrenia patients

NeuroImage

Volumn 89, Issue , 2014, Pages 171-180

  Schlagenhauf, Florian ^a,b   Huys, Quentin J M ^c,d,e   Deserno, Lorenz ^a,b   Rapp, Michael A ^a,f   Beck, Anne ^a   Heinze, Hans Joachim ^g   Dolan, Ray ^c,h   Heinz, Andreas ^a  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d UNIVERSITY OF ZURICH   (Switzerland)

^e UNIVERSITY HOSPITAL OF PSYCHIATRY ZURICH   (Switzerland)

^f MOUNT SINAI SCHOOL OF MEDICINE   (United States)

^g OTTO VON GUERICKE UNIVERSITY   (Germany)

^h HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Computational modeling; Imaging; Reversal learning; Reward; Schizophrenia; Ventral striatum

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; BRAIN DYSFUNCTION; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DISEASE DURATION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIDDEN MARKOV MODEL; HUMAN; INTELLIGENCE QUOTIENT; LEARNING; MALE; ONSET AGE; POSITIVE AND NEGATIVE SYNDROME SCALE; PRIORITY JOURNAL; PUNISHMENT; REINFORCEMENT; REWARD; SCHIZOPHRENIA; TASK PERFORMANCE; DOPAMINERGIC SYSTEM; DOUBLE UPDATE MODEL; LEARNING DISORDER; MACHINE LEARNING; PREFRONTAL CORPUS STRIATUM; RESCORLA WAGNER MODEL; VENTRAL CORPUS STRIATUM;

COMPUTATIONAL MODELING; IMAGING; REVERSAL LEARNING; REWARD; SCHIZOPHRENIA; VENTRAL STRIATUM;

ADULT; BASAL GANGLIA; BRAIN MAPPING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; REVERSAL LEARNING; REWARD; SCHIZOPHRENIA; YOUNG ADULT;

EID: 84891696800     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.11.034     Document Type: Article

References (65)

1. Andreasen N.C. A unitary model of schizophrenia: Bleuler's "fragmented phrene" as schizencephaly. Arch. Gen. Psychiatry 1999, 56:781-787.
2. Bello E.P., Mateo Y., Gelman D.M., Noain D., Shin J.H., Low M.J., Alvarez V.A., Lovinger D.M., Rubinstein M. Cocaine supersensitivity and enhanced motivation for reward in mice lacking dopamine D2 autoreceptors. Nat. Neurosci. 2011, 14:1033-1038.
3. Buchel C., Holmes A.P., Rees G., Friston K.J. Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments. NeuroImage 1998, 8:140-148.
4. Callicott J.H., Mattay V.S., Verchinski B.A., Marenco S., Egan M.F., Weinberger D.R. Complexity of prefrontal cortical dysfunction in schizophrenia: more than up or down. Am. J. Psychiatry 2003, 160:2209-2215.
5. Chamberlain S.R., Menzies L., Hampshire A., Suckling J., Fineberg N.A., del Campo N., Aitken M., Craig K., Owen A.M., Bullmore E.T., Robbins T.W., Sahakian B.J. Orbitofrontal dysfunction in patients with obsessive-compulsive disorder and their unaffected relatives. Science 2008, 321:421-422.
6. Cools R., Barker R.A., Sahakian B.J., Robbins T.W. Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb. Cortex 2001, 11:1136-1143.
7. Cools R., Clark L., Owen A.M., Robbins T.W. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J. Neurosci. 2002, 22:4563-4567.
8. Cools R., Lewis S.J., Clark L., Barker R.A., Robbins T.W. l-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 2007, 32:180-189.
9. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
10. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
11. Deserno L., Sterzer P., Wustenberg T., Heinz A., Schlagenhauf F. Reduced prefrontal-parietal effective connectivity and working memory deficits in schizophrenia. J. Neurosci. 2012, 32:12-20.
12. Dias R., Robbins T.W., Roberts A.C. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 1996, 380:69-72.
13. Elliott R., McKenna P.J., Robbins T.W., Sahakian B.J. Neuropsychological evidence for frontostriatal dysfunction in schizophrenia. Psychol. Med. 1995, 25:619-630.
14. Fellows L.K., Farah M.J. Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 2003, 126:1830-1837.
15. Fusar-Poli P., Meyer-Lindenberg A. Striatal presynaptic dopamine in schizophrenia, Part II: meta-analysis of [18F/11C]-DOPA PET studies. Schizophr. Bull. 2013, 39(1):33-42.
16. Fusar-Poli P., Howes O.D., Allen P., Broome M., Valli I., Asselin M.C., Grasby P.M., McGuire P.K. Abnormal frontostriatal interactions in people with prodromal signs of psychosis: a multimodal imaging study. Arch. Gen. Psychiatry 2010, 67:683-691.
17. Gold J.M., Waltz J.A., Prentice K.J., Morris S.E., Heerey E.A. Reward processing in schizophrenia: a deficit in the representation of value. Schizophr. Bull. 2008, 34:835-847.
18. Gradin V.B., Kumar P., Waiter G., Ahearn T., Stickle C., Milders M., Reid I., Hall J., Steele J.D. Expected value and prediction error abnormalities in depression and schizophrenia. Brain 2011, 134:1751-1764.
19. Hampton A.N., O'Doherty J.P. Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U. S. A. 2007, 104:1377-1382.
20. Hampton A.N., Bossaerts P., O'Doherty J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 2006, 26:8360-8367.
21. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 2008, 28:5623-5630.
22. Heerey E.A., Bell-Warren K.R., Gold J.M. Decision-making impairments in the context of intact reward sensitivity in schizophrenia. Biol. Psychiatry 2008, 64:62-69.
23. Heinz A. Dopaminergic dysfunction in alcoholism and schizophrenia-psychopathological and behavioral correlates. Eur. Psychiatry 2002, 17:9-16.
24. Hornak J., O'Doherty J., Bramham J., Rolls E.T., Morris R.G., Bullock P.R., Polkey C.E. Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 2004, 16:463-478.
25. Howes O.D., Kambeitz J., Kim E., Stahl D., Slifstein M., Abi-Dargham A., Kapur S. The nature of dopamine dysfunction in schizophrenia and what this means for treatment: meta-analysis of imaging studies. Arch. Gen. Psychiatry 2012 Aug, 69(8):776-786.
26. Hutton S.B., Puri B.K., Duncan L.J., Robbins T.W., Barnes T.R., Joyce E.M. Executive function in first-episode schizophrenia. Psychol. Med. 1998, 28:463-473.
27. Huys Q.J., Moutoussis M., Williams J. Are computational models of any use to psychiatry?. Neural Netw. 2011, 24:544-551.
28. Jensen J., Willeit M., Zipursky R.B., Savina I., Smith A.J., Menon M., Crawley A.P., Kapur S. The formation of abnormal associations in schizophrenia: neural and behavioral evidence. Neuropsychopharmacology 2008, 33:473-479.
29. Juckel G., Schlagenhauf F., Koslowski M., Filonov D., Wustenberg T., Villringer A., Knutson B., Kienast T., Gallinat J., Wrase J., Heinz A. Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology (Berl.) 2006, 187:222-228.
30. Juckel G., Schlagenhauf F., Koslowski M., Wustenberg T., Villringer A., Knutson B., Wrase J., Heinz A. Dysfunction of ventral striatal reward prediction in schizophrenia. NeuroImage 2006, 29:409-416.
31. Kahnt T., Park S.Q., Cohen M.X., Beck A., Heinz A., Wrase J. Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J. Cogn. Neurosci. 2009, 21:1332-1345.
32. Kapur S. Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am. J. Psychiatry 2003, 160:13-23.
33. Kay S.R., Fiszbein A., Opler L.A. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr. Bull. 1987, 13:261-276.
34. Kerns J.G., Berenbaum H. Cognitive impairments associated with formal thought disorder in people with schizophrenia. J. Abnorm. Psychol. 2002, 111:211-224.
35. Kienast T., Hariri A.R., Schlagenhauf F., Wrase J., Sterzer P., Buchholz H.G., Smolka M.N., Grunder G., Cumming P., Kumakura Y., Bartenstein P., Dolan R.J., Heinz A. Dopamine in amygdala gates limbic processing of aversive stimuli in humans. Nat. Neurosci. 2008, 11:1381-1382.
36. Koch K., Schachtzabel C., Wagner G., Schikora J., Schultz C., Reichenbach J.R., Sauer H., Schlosser R.G. Altered activation in association with reward-related trial-and-error learning in patients with schizophrenia. NeuroImage 2010, 50:223-232.
37. Leeson V.C., Robbins T.W., Matheson E., Hutton S.B., Ron M.A., Barnes T.R., Joyce E.M. Discrimination learning, reversal, and set-shifting in first-episode schizophrenia: stability over six years and specific associations with medication type and disorganization syndrome. Biol. Psychiatry 2009, 66:586-593.
38. Morris R.W., Vercammen A., Lenroot R., Moore L., Langton J.M., Short B., Kulkarni J., Curtis J., O'Donnell M., Weickert C.S., Weickert T.W. Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia. Mol. Psychiatry 2012, 17(3):280-289.
39. Murray G.K., Cheng F., Clark L., Barnett J.H., Blackwell A.D., Fletcher P.C., Robbins T.W., Bullmore E.T., Jones P.B. Reinforcement and reversal learning in first-episode psychosis. Schizophr. Bull. 2008, 34:848-855.
40. Murray G.K., Corlett P.R., Clark L., Pessiglione M., Blackwell A.D., Honey G., Jones P.B., Bullmore E.T., Robbins T.W., Fletcher P.C. Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol. Psychiatry 2008, 13:239, 267-239, 276.
41. Nielsen M.O., Rostrup E., Wulff S., Bak N., Broberg B.V., Lublin H., Kapur S., Glenthoj B. Improvement of brain reward abnormalities by antipsychotic monotherapy in schizophrenia. Arch. Gen. Psychiatry 2012, 69:1195-1204.
42. Nielsen M.O., Rostrup E., Wulff S., Bak N., Lublin H., Kapur S., Glenthoj B. Alterations of the brain reward system in antipsychotic naive schizophrenia patients. Biol. Psychiatry 2012, 71:898-905.
43. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
44. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
45. Pantelis C., Barnes T.R., Nelson H.E., Tanner S., Weatherley L., Owen A.M., Robbins T.W. Frontal-striatal cognitive deficits in patients with chronic schizophrenia. Brain 1997, 120(Pt 10):1823-1843.
46. Park S.Q., Kahnt T., Beck A., Cohen M.X., Dolan R.J., Wrase J., Heinz A. Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence. J. Neurosci. 2010, 30:7749-7753.
47. Price C.J., Friston K.J. Scanning patients with tasks they can perform. Hum. Brain Mapp. 1999, 8:102-108.
48. Ragland J.D., Cools R., Frank M., Pizzagalli D.A., Preston A., Ranganath C., Wagner A.D. CNTRICS final task selection: long-term memory. Schizophr. Bull. 2009, 35:197-212.
49. Remijnse P.L., Nielen M.M., van Balkom A.J., Cath D.C., van Oppen P., Uylings H.B., Veltman D.J. Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder. Arch. Gen. Psychiatry 2006, 63:1225-1236.
50. Robinson T.E., Berridge K.C. Review. The incentive sensitization theory of addiction: some current issues. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2008, 363:3137-3146.
51. Romaniuk L., Honey G.D., King J.R., Whalley H.C., McIntosh A.M., Levita L., Hughes M., Johnstone E.C., Day M., Lawrie S.M., Hall J. Midbrain activation during Pavlovian conditioning and delusional symptoms in schizophrenia. Arch. Gen. Psychiatry 2010, 67:1246-1254.
52. Schlagenhauf F., Juckel G., Koslowski M., Kahnt T., Knutson B., Dembler T., Kienast T., Gallinat J., Wrase J., Heinz A. Reward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine. Psychopharmacology (Berl.) 2008, 196:673-684.
53. Schlagenhauf F., Sterzer P., Schmack K., Ballmaier M., Rapp M., Wrase J., Juckel G., Gallinat J., Heinz A. Reward feedback alterations in unmedicated schizophrenia patients: relevance for delusions. Biol. Psychiatry 2009, 65:1032-1039.
54. Schlagenhauf F., Rapp M.A., Huys Q.J., Beck A., Wustenberg T., Deserno L., Buchholz H.G., Kalbitzer J., Buchert R., Bauer M., Kienast T., Cumming P., Plotkin M., Kumakura Y., Grace A.A., Dolan R.J., Heinz A. Ventral striatal prediction error signaling is associated with dopamine synthesis capacity and fluid intelligence. Hum. Brain Mapp. 2013 Jun, 34(6):1490-1499.
55. Schmidt K., Metzler P. Wortschatztest (WST) 1992, Beltz test, Weinheim.
56. Schultz W. Behavioral dopamine signals. Trends Neurosci. 2007, 30:203-210.
57. Stephan K.E., Friston K.J., Frith C.D. Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring. Schizophr. Bull. 2009, 35:509-527.
58. Strauss G.P., Frank M.J., Waltz J.A., Kasanova Z., Herbener E.S., Gold J.M. Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biol. Psychiatry 2011, 69:424-431.
59. Swainson R., Rogers R.D., Sahakian B.J., Summers B.A., Polkey C.E., Robbins T.W. Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 2000, 38:596-612.
60. Tan H.Y., Sust S., Buckholtz J.W., Mattay V.S., Meyer-Lindenberg A., Egan M.F., Weinberger D.R., Callicott J.H. Dysfunctional prefrontal regional specialization and compensation in schizophrenia. Am. J. Psychiatry 2006, 163:1969-1977.
61. Waltz J.A., Gold J.M. Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr. Res. 2007, 93:296-303.
62. Waltz J.A., Schweitzer J.B., Gold J.M., Kurup P.K., Ross T.J., Salmeron B.J., Rose E.J., McClure S.M., Stein E.A. Patients with schizophrenia have a reduced neural response to both unpredictable and predictable primary reinforcers. Neuropsychopharmacology 2009, 34:1567-1577.
63. Waltz J.A., Kasanova Z., Ross T.J., Salmeron B.J., McMahon R.P., Gold J.M., Stein E.A. The roles of reward, default, and executive control networks in set-shifting impairments in schizophrenia. PLoS One 2013, 8:e57257.
64. Weickert T.W., Goldberg T.E., Callicott J.H., Chen Q., Apud J.A., Das S., Zoltick B.J., Egan M.F., Meeter M., Myers C., Gluck M.A., Weinberger D.R., Mattay V.S. Neural correlates of probabilistic category learning in patients with schizophrenia. J. Neurosci. 2009, 29:1244-1254.
65. Weickert T.W., Goldberg T.E., Egan M.F., Apud J.A., Meeter M., Myers C.E., Gluck M.A., Weinberger D.R. Relative risk of probabilistic category learning deficits in patients with schizophrenia and their siblings. Biol. Psychiatry 2010, 67:948-955.