Effects of depression on reward-based decision making and variability of action in probabilistic learning

Journal of Behavior Therapy and Experimental Psychiatry

Volumn 43, Issue 4, 2012, Pages 1088-1094

  Kunisato, Yoshihiko ^a   Okamoto, Yasumasa ^b,c   Ueda, Kazutaka ^d   Onoda, Keiichi ^e   Okada, Go ^b,f   Yoshimura, Shinpei ^b,g   Suzuki, Shin Ichi ^a   Samejima, Kazuyuki ^h   Yamawaki, Shigeto ^b,c  

^a WASEDA UNIVERSITY   (Japan)

^b HIROSHIMA UNIVERSITY   (Japan)

^c JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^d UNIVERSITY OF TOKYO   (Japan)

^e SHIMANE UNIVERSITY   (Japan)

^f UNIVERSITY OF MICHIGAN HEALTH SYSTEM   (United States)

^g JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

^h TAMAGAWA UNIVERSITY   (Japan)

Author keywords

Decision making; Depression; Probabilistic learning; Reinforcement learning; Reward sensitivity; Variability of action selection

Indexed keywords

ADULT; ARTICLE; CLINICAL ARTICLE; COMPARATIVE STUDY; DECISION MAKING; DEPRESSION; FEMALE; HUMAN; LEARNING; MALE; REACTION ANALYSIS; REINFORCEMENT; REWARD; TASK PERFORMANCE; UNDERGRADUATE STUDENT;

DECISION MAKING; DEPRESSION; DEPRESSIVE DISORDER; FEMALE; HUMANS; MALE; PROBABILITY LEARNING; REINFORCEMENT (PSYCHOLOGY); REWARD; YOUNG ADULT;

EID: 84862287089     PISSN: 00057916     EISSN: 18737943     Source Type: Journal    
DOI: 10.1016/j.jbtep.2012.05.007     Document Type: Article

References (37)

1. B. Abler, G. Gron, A. Hartmann, C. Metzger, and M. Walter Modulation of frontostriatal interaction aligns with reduced primary reward processing under serotonergic drugs The Journal of Neuroscience 32 2012 1329 1335
2. American Psychiatric Association Diagnostic and statistical manual of mental disorders 4th ed., text revision 2000 American Psychiatric Association Washington, DC
3. A.T. Beck, R.A. Steer, and G.K. Brown Beck depression inventory manual 2nd ed. 1996 The Psychological Corporation San Antonio, Texas
4. T.E. Behrens, M.W. Woolrich, M.E. Walton, and M.F. Rushworth Learning the value of information in an uncertain world Nature Neuroscience 10 2007 1214 1221
5. T.A. Brown, B.F. Chorpita, and D.H. Barlow Structural relationships among dimensions of the DSM-IV anxiety and mood disorders and dimensions of negative affect, positive affect, and autonomic arousal Journal of Abnormal Psychology 107 1998 179 192
6. J.R. Busemeyer, and J.C. Stout A contribution of cognitive decision models to clinical assessment: decomposing performance on the Bechara gambling task Psychological Assessment 14 2002 253 262
7. H.W. Chase, M.J. Frank, A. Michael, E.T. Bullmore, B.J. Sahakian, and T.W. Robbins Approach and avoidance learning in patients with major depression and healthy controls: relation to anhedonia Psychological Medicine 40 2010 433 440
8. E.J. Costello Information processing for decision making in depressed women. A study of subjective expected utilities Journal of Affective Disorders 5 1983 239 251
9. N.D. Daw, J.P. O'Doherty, P. Dayan, B. Seymour, and R.J. Dolan Cortical substrates for exploratory decisions in humans Nature 441 2006 876 879
10. R.A. Depue, and W.G. Iacono Neurobehavioral aspects of affective disorders Annual Review of Psychology 40 1989 457 492
11. N. Endo, J. Saiki, Y. Nakao, and H. Saito Perceptual judgments of novel contour shapes based on their hierarchical descriptions of geometrical properties Japanese Journal of Psychology 74 2003 346 353
12. N. Eshel, and J.P. Roiser Reward and punishment processing in depression Biological Psychiatry 68 2010 118 124
13. M.J. Frank, A.A. Moustafa, H.M. Haughey, T. Curran, and K.E. Hutchison Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning Proceedings of the National Academy of Sciences of the United States of America 104 2007 16311 16316
14. M.J. Frank, L.C. Seeberger, and R.C. O'Reilly By carrot or by stick: cognitive reinforcement learning in parkinsonism Science 306 2004 1940 1943
15. M.J. Frank, B.S. Woroch, and T. Curran Error-related negativity predicts reinforcement learning and conflict biases Neuron 47 2005 495 501
16. J.B. Henriques, and R.J. Davidson Decreased responsiveness to reward in depression Cognition & Emotion 14 2000 711 724
17. J.B. Henriques, J.M. Glowacki, and R.J. Davidson Reward fails to alter response bias in depression Journal of Abnormal Psychology 103 1994 460 466
18. Q.J. Huys, and P. Dayan A Bayesian formulation of behavioral control Cognition 113 2009 314 328
19. K.L. Kasch, J. Rottenberg, B.A. Arnow, and I.H. Gotlib Behavioral activation and inhibition systems and the severity and course of depression Journal of Abnormal Psychology 111 2002 589 597
20. G. Loas Vulnerability to depression: a model centered on anhedonia Journal of Affective Disorders 41 1996 39 53
21. C. McCabe, and Z. Mishor Antidepressant medications reduce subcortical-cortical resting-state functional connectivity in healthy volunteers NeuroImage 57 2011 1317 1323
22. B.R. McFarland, S.A. Shankman, C.E. Tenke, G.E. Bruder, and D.N. Klein Behavioral activation system deficits predict the six-month course of depression Journal of Affective Disorders 91 2006 229 234
23. J. O'Doherty, P. Dayan, J. Schultz, R. Deichmann, K. Friston, and R.J. Dolan Dissociable roles of ventral and dorsal striatum in instrumental conditioning Science 304 2004 452 454
24. H. Ohira, S. Fukuyama, K. Kimura, M. Nomura, T. Isowa, and N. Ichikawa Regulation of natural killer cell redistribution by prefrontal cortex during stochastic learning NeuroImage 47 2009 897 907
25. H. Ohira, N. Ichikawa, M. Nomura, T. Isowa, K. Kimura, and N. Kanayama Brain and autonomic association accompanying stochastic decision-making NeuroImage 49 2010 1024 1037
26. L. Ossewaarde, R.J. Verkes, E.J. Hermans, S.C. Kooijman, M. Urner, and I. Tendolkar Two-week administration of the combined serotonin-noradrenaline reuptake inhibitor duloxetine augments functioning of mesolimbic incentive processing circuits Biological Psychiatry 70 2011 568 574
27. D.A. Pizzagalli, D. Iosifescu, L.A. Hallett, K.G. Ratner, and M. Fava Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task Journal of Psychiatric Research 43 2008 76 87
28. D.A. Pizzagalli, A.L. Jahn, and J.P. O'Shea Toward an objective characterization of an anhedonic phenotype: a signal-detection approach Biological Psychiatry 57 2005 319 327
29. L.S. Radloff The CES-D scale: a self-report depression scale for research in the General Population Applied Psychological Measurement 1 1977 385 401
30. K. Samejima, Y. Ueda, K. Doya, and M. Kimura Representation of action-specific reward values in the striatum Science 310 2005 1337 1340
31. D.M. Small, D. Gitelman, K. Simmons, S.M. Bloise, T. Parrish, and M.M. Mesulam Monetary incentives enhance processing in brain regions mediating top-down control of attention Cerebral Cortex 15 2005 1855 1865
32. J.D. Steele, P. Kumar, and K.P. Ebmeier Blunted response to feedback information in depressive illness Brain 130 2007 2367 2374
33. M. Stoy, F. Schlagenhauf, P. Sterzer, F. Bermpohl, C. Hagele, and K. Suchotzki Hyporeactivity of ventral striatum towards incentive stimuli in unmedicated depressed patients normalizes after treatment with escitalopram Journal of Psychopharmacology 26 2012 677 688
34. R.S. Sutton, and A.G. Barto Reinforcement learning: An introduction 1998 MIT Press Cambridge, MA
35. S.C. Tanaka, K. Doya, G. Okada, K. Ueda, Y. Okamoto, and S. Yamawaki Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops Nature Neuroscience 7 2004 887 893
36. D. Watson, L.A. Clark, and A. Tellegen Development and validation of brief measures of positive and negative affect: the PANAS scales Journal of Personality and Social Psychology 54 1988 1063 1070
37. D. Watson, K. Weber, J.S. Assenheimer, L.A. Clark, M.E. Strauss, and R.A. McCormick Testing a tripartite model: I. Evaluating the convergent and discriminant validity of anxiety and depression symptom scales Journal of Abnormal Psychology 104 1995 3 14