Predicting psychosis across diagnostic boundaries: Behavioral and computational modeling evidence for impaired reinforcement learning in schizophrenia and bipolar disorder with a history of psychosis

Journal of Abnormal Psychology

Volumn 124, Issue 3, 2015, Pages 697-708

  Strauss, Gregory P ^a   Thaler, Nicholas S ^b   Matveeva, Tatyana M ^c   Vogel, Sally J ^b   Sutton, Griffin P ^b   Lee, Bern G ^b   Allen, Daniel N ^b  

^a BINGHAMTON UNIVERSITY   (United States)

^b UNIVERSITY OF NEVADA   (United States)

^c UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Aberrant salience; Psychosis; Reinforcement learning; Reward

Indexed keywords

ADULT; ANALYTICAL ERROR; ARTICLE; BASAL GANGLION; BIPOLAR DISORDER; CONTROLLED STUDY; DECISION MAKING; DISEASE SEVERITY; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; MATHEMATICAL MODEL; MENTAL PERFORMANCE; ORBITAL CORTEX; PREDICTION; PSYCHOSIS; REINFORCEMENT; REWARD; SCHIZOPHRENIA; STATISTICAL ANALYSIS; STIMULUS RESPONSE; TASK PERFORMANCE; LEARNING; MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL RATING SCALE; PSYCHOLOGY; YOUNG ADULT;

ADULT; BIPOLAR DISORDER; DECISION MAKING; FEMALE; HUMANS; LEARNING; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; NEUROPSYCHOLOGICAL TESTS; PSYCHIATRIC STATUS RATING SCALES; PSYCHOTIC DISORDERS; REINFORCEMENT (PSYCHOLOGY); SCHIZOPHRENIC PSYCHOLOGY; YOUNG ADULT;

EID: 84938967035     PISSN: 0021843X     EISSN: 19391846     Source Type: Journal    
DOI: 10.1037/abn0000039     Document Type: Article

References (54)

1. Allen, D. N., Randall, C., Bello, D., Armstrong, C., Frantom, L., Cross, C., & Kinney, J. (2010). Are working memory deficits in bipolar disorder markers for psychosis? Neuropsychology, 24, 244-254. http://dx.doi.org/10.1037/a0018159
2. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: Author.
3. Andreasen, N. C. (1984). Scale for the Assessment of Positive Symptoms (SAPS). Iowa City: University of Iowa.
4. Barr, R. S., Pizzagalli, D. A., Culhane, M. A., Goff, D. C., & Evins, A. E. (2008). A single dose of nicotine enhances reward responsiveness in nonsmokers: Implications for development of dependence. Biological Psychiatry, 63, 1061-1065. http://dx.doi.org/10.1016/j.biopsych.2007.09.015
5. Berrettini, W. (2003a). Bipolar disorder and schizophrenia: Not so distant relatives? World Psychiatry; Official Journal of the World Psychiatric Association (WPA), 2, 68-72.
6. Berrettini, W. (2003b). Evidence for shared susceptibility in bipolar disorder and schizophrenia. American Journal of Medical Genetics. Part C, Seminars in Medical Genetics, 123C(1), 59 - 64. http://dx.doi.org/ 10.1002/ajmg.c.20014
7. Corlett, P. R., Frith, C. D., & Fletcher, P. C. (2009). From drugs to deprivation: A Bayesian framework for understanding models of psychosis. Psychopharmacology, 206, 515-530. http://dx.doi.org/10.1007/ s00213-009-1561-0
8. Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007). From prediction error to psychosis: Ketamine as a pharmacological model of delusions. Journal of Psychopharmacology, 21, 238 -252. http://dx.doi.org/ 10.1177/0269881107077716
9. Corlett, P. R., Murray, G. K., Honey, G. D., Aitken, M. R., Shanks, D. R., Robbins, T. W.,... Fletcher, P. C. (2007). Disrupted prediction-error signal in psychosis: Evidence for an associative account of delusions. Brain, 130(Pt. 9), 2387-2400. http://dx.doi.org/10.1093/brain/awm173
10. Craddock, N., O'Donovan, M. C., & Owen, M. J. (2005). The genetics of schizophrenia and bipolar disorder: Dissecting psychosis. Journal of Medical Genetics, 42, 193-204.
11. Craddock, N., O'Donovan, M. C., & Owen, M. J. (2007). Phenotypic and genetic complexity of psychosis Invited commentary on... Schizophrenia:A common disease caused by multiple rare alleles. The British Journal of Psychiatry, 190, 200-203.
12. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2001). Structured Clinical Interview for DSM-IV-TR Axis I Disorders-Patient Edition (SCID-I/P 2/2001 Revision). New York, NY: Biometrics Research Department, New York State Psychiatric Institute.
13. Frank, M. J. (2008). Schizophrenia: A computational reinforcement learning perspective. Schizophrenia Bulletin, 34, 1008-1011. http://dx.doi.org/10.1093/schbul/sbn123
14. Frank, M. J., & Claus, E. D. (2006). Anatomy of a decision: Striatoorbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Review, 113, 300-326. http://dx.doi.org/ 10.1037/0033-295X.113.2.300
15. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004, December 10). By carrot or by stick: Cognitive reinforcement learning in Parkinsonism. Science, 306, 1940-1943. http://dx.doi.org/10.1126/science.1102941
16. Frye, M. A., Ketter, T. A., Altshuler, L. L., Denicoff, K., Dunn, R. T., Kimbrell, T. A.,... Post, R. M. (1998). Clozapine in bipolar disorder:Treatment implications for other atypical antipsychotics. Journal of Affective Disorders, 48, 91-104.
17. Furuyashiki, T., & Gallagher, M. (2007). Neural encoding in the orbitofrontal cortex related to goal-directed behavior. Annals of the New York Academy of Sciences, 1121, 193-215. http://dx.doi.org/10.1196/annals.1401.037
18. Glahn, D. C., Bearden, C. E., Cakir, S., Barrett, J. A., Najt, P., Serap Monkul, E.,... Soares, J. C. (2006). Differential working memory impairment in bipolar disorder and schizophrenia: Effects of lifetime history of psychosis. Bipolar Disorders, 8, 117-123. http://dx.doi.org/ 10.1111/j.1399-5618.2006.00296.x
19. Gold, J. M., Strauss, G. P., Waltz, J. A., Robinson, B. M., Brown, J. K., & Frank, M. J. (2013). Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biological Psychiatry, 74, 130-136. http://dx.doi.org/10.1016/j.biopsych.2012.12.022
20. Gold, J. M., Waltz, J. A., Matveeva, T. M., Kasanova, Z., Strauss, G. P., Herbener, E. S.,... Frank, M. J. (2012). Negative symptoms and the failure to represent the expected reward value of actions: Behavioral and computational modeling evidence. Archives of General Psychiatry, 69, 129-138. http://dx.doi.org/10.1001/archgenpsychiatry.2011.1269
21. Grace, A. A. (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia. Neuroscience, 41, 1-24.
22. Greene, T. (2007). The Kraepelinian dichotomy: The twin pillars crumbling? History of Psychiatry, 18, 361-379. http://dx.doi.org/10.1177/ 0957154X07078977
23. Heckers, S. (2008). Making progress in schizophrenia research. Schizophrenia Bulletin, 34, 591-594. http://dx.doi.org/10.1093/schbul/sbn046
24. Hill, S. K., Harris, M. S., Herbener, E. S., Pavuluri, M., & Sweeney, J. A. (2008). Neurocognitive allied phenotypes for schizophrenia and bipolar disorder. Schizophrenia Bulletin, 34, 743-759. http://dx.doi.org/ 10.1093/schbul/sbn027
25. Joel, D., Niv, Y., & Ruppin, E. (2002). Actor-critic models of the basal ganglia: New anatomical and computational perspectives. Neural Networks, 15, 535-547. http://dx.doi.org/10.1016/S0893-6080(02)00047-3
26. Keshavan, M. S., Morris, D. W., Sweeney, J. A., Pearlson, G., Thaker, G., Seidman, L. J.,... Tamminga, C. (2011). A dimensional approach to the psychosis spectrum between bipolar disorder and schizophrenia: The Schizo-Bipolar Scale. Schizophrenia Research, 133, 250-254. http://dx.doi.org/10.1016/j.schres.2011.09.005
27. Laruelle, M., & Abi-Dargham, A. (1999). Dopamine as the wind of the psychotic fire: New evidence from brain imaging studies. Journal of Psychopharmacology, 13, 358 -371. http://dx.doi.org/10.1177/ 026988119901300405
28. Linke, J., Sönnekes, C., & Wessa, M. (2011). Sensitivity to positive and negative feedback in euthymic patients with bipolar I disorder: The last episode makes the difference. Bipolar Disorders, 13, 638-650. http:// dx.doi.org/10.1111/j.1399-5618.2011.00956.x
29. Montague, P. R. (1999). Reinforcement learning: An introduction. Trends in Cognitive Sciences, 3, 360-361. http://dx.doi.org/10.1016/S1364-6613(99)01331-5
30. Nakamura, M., Nestor, P. G., Levitt, J. J., Cohen, A. S., Kawashima, T., Shenton, M. E., & McCarley, R. W. (2008). Orbitofrontal volume deficit in schizophrenia and thought disorder. Brain, 131, 180-195. http://dx.doi.org/10.1093/brain/awm265
31. Pizzagalli, D. A., Goetz, E., Ostacher, M., Iosifescu, D. V., & Perlis, R. H. (2008). Euthymic patients with bipolar disorder show decreased reward learning in a probabilistic reward task. Biological Psychiatry, 64, 162-168. http://dx.doi.org/10.1016/j.biopsych.2007.12.001
32. Plassmann, H., O'Doherty, J. P., & Rangel, A. (2010). Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. Journal of Neuroscience, 30, 10799-10808. http://dx.doi.org/10.1523/JNEUROSCI.0788-10.2010
33. Post, R. M., Frye, M. A., Denicoff, K. D., Leverich, G. S., Kimbrell, T. A., & Dunn, R. T. (1998). Beyond lithium in the treatment of bipolar illness. Neuropsychopharmacology, 19, 206 -219. http://dx.doi.org/10.1016/S0893-133X(98)00020-7
34. Potash, J. B., Chiu, Y. F., MacKinnon, D. F., Miller, E. B., Simpson, S. G., McMahon, F. J.,... DePaulo, J. R. (2003). Familial aggregation of psychotic symptoms in a replication set of 69 bipolar disorder pedigrees. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics, 116, 90-97.
35. Ringe, W. K., Saine, K. C., Lacritz, L. H., Hynan, L. S., & Cullum, C. M. (2002). Dyadic short forms of the Wechsler Adult Intelligence Scale-III. Assessment, 9, 254-260. http://dx.doi.org/10.1177/1073191102009003004
36. Roesch, M. R., & Olson, C. R. (2007). Neuronal activity related to anticipated reward in frontal cortex: Does it represent value or reflect motivation? Annals of the New York Academy of Sciences, 1121, 431-446. http://dx.doi.org/10.1196/annals.1401.004
37. Roiser, J. P., Cannon, D. M., Gandhi, S. K., Taylor Tavares, J., Erickson, K., Wood, S.,... Drevets, W. C. (2009). Hot and cold cognition in unmedicated depressed subjects with bipolar disorder. Bipolar Disorders, 11, 178-189. http://dx.doi.org/10.1111/j.1399-5618.2009.00669.x
38. Schlagenhauf, F., Huys, Q. J., Deserno, L., Rapp, M. A., Beck, A., Heinze, H. J.,... Heinz, A. (2014). Striatal dysfunction during reversal learning in unmedicated schizophrenia patients. Neuroimage, 89, 171-180.
39. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1-27.
40. Seidman, L. J., Kremen, W. S., Koren, D., Faraone, S. V., Goldstein, J. M., & Tsuang, M. T. (2002). A comparative profile analysis of neuropsychological functioning in patients with schizophrenia and bipolar psychoses. Schizophrenia Research, 53, 31-44.
41. Singh, M. K., Chang, K. D., Kelley, R. G., Cui, X., Sherdell, L., Howe, M. E.,... Reiss, A. L. (2013). Reward processing in adolescents with bipolar I disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 68-83. http://dx.doi.org/10.1016/j.jaac.2012.10.004
42. Stanfield, A. C., Moorhead, T. W., Job, D. E., McKirdy, J., Sussmann, J. E., Hall, J.,... McIntosh, A. M. (2009). Structural abnormalities of ventrolateral and orbitofrontal cortex in patients with familial bipolar disorder. Bipolar Disorders, 11, 135-144. http://dx.doi.org/10.1111/j.1399-5618.2009.00666.x
43. Strauss, G. P., Frank, M. J., Waltz, J. A., Kasanova, Z., Herbener, E. S., & Gold, J. M. (2011). Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biological Psychiatry, 69, 424-431. http://dx.doi.org/10.1016/j.biopsych.2010.10.015
44. Strauss, G. P., Robinson, B. M., Waltz, J. A., Frank, M. J., Kasanova, Z., Herbener, E. S., & Gold, J. M. (2011). Patients with schizophrenia demonstrate inconsistent preference judgments for affective and nonaffective stimuli. Schizophrenia Bulletin, 37, 1295-1304. http://dx.doi.org/ 10.1093/schbul/sbq047
45. Sutton, R., & Barto, A. G. (1998). Reinforcement Learning. Cambridge, MA: MIT Press.
46. Thaler, N. S., Allen, D. N., Sutton, G. P., Vertinski, M., & Ringdahl, E. N. (2013). Differential impairment of social cognition factors in bipolar disorder with and without psychotic features and schizophrenia. Journal of Psychiatric Research, 47, 2004-2010. http://dx.doi.org/10.1016/j.jpsychires.2013.09.010
47. Thaler, N. S., Strauss, G. P., Sutton, G. P., Vertinski, M., Ringdahl, E. N., Snyder, J. S., & Allen, D. N. (2013). Emotion perception abnormalities across sensory modalities in bipolar disorder with psychotic features and schizophrenia. Schizophrenia Research, 147, 287-292. http://dx.doi.org/ 10.1016/j.schres.2013.04.001
48. Waltz, J. A., Frank, M. J., Robinson, B. M., & Gold, J. M. (2007). Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biological Psychiatry, 62, 756-764. http://dx.doi.org/10.1016/j.biopsych.2006.09.042
49. Waltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011). Altered probabilistic learning and response biases in schizophrenia: Behavioral evidence and neurocomputational modeling. Neuropsychology, 25, 86-97. http://dx.doi.org/10.1037/a0020882
50. Waltz, J. A., & Gold, J. M. (2007). Probabilistic reversal learning impairments in schizophrenia: Further evidence of orbitofrontal dysfunction. Schizophrenia Research, 93, 296 -303. http://dx.doi.org/10.1016/j.schres.2007.03.010
51. Waltz, J. A., Kasanova, Z., Ross, T. J., Salmeron, B. J., McMahon, R. P., Gold, J. M., & Stein, E. A. (2013). The roles of reward, default, and executive control networks in set-shifting impairments in schizophrenia. PLoS ONE, 8(2), e57257. http://dx.doi.org/10.1371/journal.pone.0057257
52. Waltz, J. A., Schweitzer, J. B., Ross, T. J., Kurup, P. K., Salmeron, B. J., Rose, E. J.,... Stein, E. A. (2010). Abnormal responses to monetary outcomes in cortex, but not in the basal ganglia, in schizophrenia. Neuropsychopharmacology, 35, 2427-2439. http://dx.doi.org/10.1038/ npp.2010.126
53. Wechsler, D. (1997). Wechsler Adult Intelligence Scale (3rd ed.) administration and scoring manual. San Antonio, TX: Psychological Corporation.
54. Yu, K., Cheung, C., Leung, M., Li, Q., Chua, S., & McAlonan, G. (2010). Are bipolar disorder and schizophrenia neuroanatomically distinct? An anatomical likelihood meta-analysis. Frontiers in Human Neuroscience, 4, 189. http://dx.doi.org/10.3389/fnhum.2010.00189