Depression: A Decision-Theoretic Analysis

Annual Review of Neuroscience

Volumn 38, Issue , 2015, Pages 1-23

  Huys, Quentin J M ^a,b   Daw, Nathaniel D ^c   Dayan, Peter ^d  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b UNIVERSITY HOSPITAL OF PSYCHIATRY   (Switzerland)

^c NEW YORK UNIVERSITY   (United States)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Decision theory; Depression; Model based control; Model free control; Reinforcement learning

Indexed keywords

DOPAMINE;

ANTERIOR CINGULATE; ARTICLE; BAYES THEOREM; DECISION MAKING; DECISION THEORY; DECISION TREE; DEPRESSION; DOPAMINERGIC ACTIVITY; ELECTRODERMAL RESPONSE; EMOTIONALITY; ENVIRONMENTAL FACTOR; FACIAL EXPRESSION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEART RATE VARIABILITY; HELPLESSNESS; HUMAN; HYPERSOMNIA; HYPOACTIVITY; INSOMNIA; LEARNED HELPLESSNESS; NUCLEUS ACCUMBENS; PARKINSON DISEASE; PESSIMISM; POSITIVE FEEDBACK; PRIORITY JOURNAL; PUTAMEN; REINFORCEMENT; REINFORCEMENT LEARNING; REWARD; SELF REPORT; THERAPY EFFECT; THINKING; VOLUNTARY MOVEMENT; WEIGHT GAIN; WEIGHT REDUCTION;

BAYES THEOREM; DECISION MAKING; DECISION THEORY; DEPRESSION; HUMANS;

EID: 84929597054     PISSN: 0147006X     EISSN: 15454126     Source Type: Book Series    
DOI: 10.1146/annurev-neuro-071714-033928     Document Type: Article

References (159)

1. Abramson LY, SeligmanME, Teasdale JD. 1978. Learned helplessness in humans: critique and reformulation. J. Abnorm. Psychol. 87(1):49-74
2. Alloy LB, Abramson LY, Whitehouse WG, Hogan ME, Tashman NA, et al. 1999. Depressogenic cognitive styles: predictive validity, information processing and personality characteristics, and developmental origins. Behav. Res. Ther. 37(6):503-31
3. Am. Psychiatr. Assoc. 2013. Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: Am. Psychiatr. Assoc. 5th ed.
4. Amat J, Baratta MV, Paul E, Bland ST, Watkins LR, Maier SF. 2005. Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus. Nat. Neurosci. 8(3):365-71
5. Amemori K-I, Graybiel AM. 2012. Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat. Neurosci. 15(5):776-85
6. Amsterdam JD, Settle RG, Doty RL, Abelman E, Winokur A. 1987. Taste and smell perception in depression. Biol. Psychiatry 22(12):1481-85
7. Ariely D, Loewenstein G, Prelec D. 2003. Coherent arbitrariness: stable demand curves without stable preferences. Q. J. Econ. 118(1):73-105
8. Armstrong T, Olatunji BO. 2012. Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clin. Psychol. Rev. 32(8):704-23
9. Barry ES, Naus MJ, Rehm LP. 2004. Depression and implicit memory: understanding mood congruent memory bias. Cogn. Ther. Res. 28(3):387-414
10. Bartlett FC. 1932. Remembering: A Study in Experimental and Social Psychology. Cambridge, UK: Cambridge Univ. Press
11. Beck AT. 1967. Depression: Clinical, Experimental and Theoretical Aspects. New York: Harper & Row
12. Beck AT. 1976. Cognitive Therapy and the Emotional Disorders. New York: Int. Univ. Press
13. Berlin I, Givry-Steiner L, Lecrubier Y, Puech AJ. 1998. Measures of anhedonia and hedonic responses to sucrose in depressive and schizophrenic patients in comparison with healthy subjects. Eur. Psychiatry 13(6):303-9
14. Berridge KC, Robinson TE. 1998. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28(3):209-69
15. Blackwell SE, Holmes EA. 2010. Modifying interpretation and imagination in clinical depression: A single case series using cognitive bias modification. Appl. Cogn. Psychol. 24(3):338-50
16. Boureau Y-L, Dayan P. 2011. Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 36(1):74-97
17. Borkovec TD, Roemer L. 1995. Perceived functions of worry among generalized anxiety disorder subjects: distraction from more emotionally distressing topics? J. Behav. Ther. Exp. Psychiatry 26(1):25-30
18. Buchsbaum MS. 1979. Neurophysiological reactivity, stimulus intensity modulation and the depressive disorders. In The Psychobiology of Depressive Disorders: Implications for the Effects of Stress, ed. RA Depue, pp. 221-42. New York: Academic
19. Burke HM, Davis MC, Otte C, Mohr DC. 2005. Depression and cortisol responses to psychological stress: A meta-analysis. Psychoneuroendocrinology 30(9):846-56
20. Bylsma LM, Morris BH, Rottenberg J. 2008. A meta-analysis of emotional reactivity in major depressive disorder. Clin. Psychol. Rev. 28(4):676-91
21. CandyM, Jones L, WilliamsR, TookmanA, KingM. 2008. Psychostimulants for depression. Cochrane Database Syst. Rev. 2008(2):CD006722
22. Caseras X, GarnerM, Bradley BP, Mogg K. 2007. Biases in visual orienting to negative and positive scenes in dysphoria: An eye movement study. J. Abnorm. Psychol. 116(3):491-97
23. Chase HW, Frank MJ, Michael A, Bullmore ET, Sahakian BJ, Robbins TW. 2009. Approach and avoidance learning in patients with major depression and healthy controls: Relation to anhedonia. Psychol. Med. 40(3):433-40
24. Chikkerur S, Serre T, Tan C, Poggio T. 2010. What and where: A Bayesian inference theory of attention. Vision Res. 50(22):2233-47
25. Clepce M, Gossler A, Reich K, Kornhuber J, Thuerauf N. 2010. The relation between depression, anhedonia and olfactory hedonic estimates-a pilot study in major depression. Neurosci. Lett. 471(3):139-43
26. Coan JA, Allen JJB. 2007. Handbook of Emotion Elicitation and Assessment. New York: Oxford Univ. Press
27. Cohen JD, Braver TS, O'Reilly RC. 1996. A computational approach to prefrontal cortex, cognitive control and schizophrenia: Recent developments and current challenges. Philos. Trans. R. Soc. Lond. B Biol. Sci. 351(1346):1515-27
28. Cools R, Nakamura K, Daw ND. 2011. Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 36(1):98-113
29. Cowden Hindash AH, Amir N. 2012. Negative interpretation bias in individuals with depressive symptoms. Cogn. Ther. Res. 36(5):502-11
30. Crockett MJ, Clark L, Robbins TW. 2009. Reconciling the role of serotonin in behavioral inhibition and aversion: Acute tryptophan depletion abolishes punishment-induced inhibition in humans. J. Neurosci. 29(38):11993-99
31. Cutrona CE. 1983. Causal attributions and perinatal depression. J. Abnorm. Psychol. 92(2):161-72
32. Dantzer R, O'Connor JC, Freund GG, Johnson RW, Kelley KW. 2008. From inflammation to sickness and depression: when the immune system subjugates the brain. Nat. Rev. Neurosci. 9(1):46-56
33. D'Avanzato C, Joormann J, Siemer M, Gotlib IH. 2013. Emotion regulation in depression and anxiety: examining diagnostic specificity and stability of strategy use. Cogn. Ther. Res. 37(5):968-80
34. Daw ND, Dayan P. 2014. The algorithmic anatomy of model-based evaluation. Philos. Trans. R. Soc. Lond. B Biol. Sci. 369(1655):20130478
35. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. 2011. Model-based influences on humans' choices and striatal prediction errors. Neuron 69(6):1204-15
36. Daw ND, Niv Y, Dayan P. 2005. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8(12):1704-11
37. Dayan P. 2012. How to set the switches on this thing. Curr. Opin. Neurobiol. 22(6):1068-74
38. Dayan P, Daw ND. 2008. Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 8(4):429-53
39. Dayan P, Huys QJM. 2008. Serotonin, inhibition, and negative mood. PLOS Comput. Biol. 4(2):e4
40. Dayan P, Niv Y, Seymour B, Daw ND. 2006. The misbehavior of value and the discipline of the will. Neural Netw. 19(8):1153-60
41. Dichter GS, Smoski MJ, Kampov-Polevoy AB, Gallop R, Garbutt JC. 2010. Unipolar depression does not moderate responses to the sweet taste test. Depress Anxiety 27(9):859-63
42. Dickinson A. 1980. Contemporary Animal Learning Theory. Cambridge, UK: Cambridge Univ. Press
43. Diener C, Kuehner C, Brusniak W, Ubl B, Wessa M, Flor H. 2012. A meta-analysis of neurofunctional imaging studies of emotion and cognition in major depression. Neuroimage 61(3):677-85
44. DillonDG, PizzagalliDA2013. Evidence of successful modulation of brain activation and subjective experience during reappraisal of negative emotion in unmedicated depression. Psychiatry Res. Neuroimaging 212:99-107
45. Dombrovski AY, Cyranowski JM, Mulsant BH, Houck PR, Buysse DJ, et al. 2008. Which symptoms predict recurrence of depression in women treated with maintenance interpersonal psychotherapy? Depress. Anxiety 25(12):1060-66
46. Ehring T, Tuschen-Caffier B, Schnülle J, Fischer S, Gross JJ. 2010. Emotion regulation and vulnerability to depression: spontaneous versus instructed use of emotion suppression and reappraisal. Emotion 10(4):563-72
47. Eldar E, Niv Y. 2015. Interaction between emotional state and learning underlies mood instability. Nat. Commun. 6:6149
48. Elliott R, Sahakian BJ, Herrod JJ, Robbins TW, Paykel ES. 1997. Abnormal response to negative feedback in unipolar depression: evidence for a diagnosis-specific impairment. J. Neurol. Neurosurg. Psychiatry 63:74-82
49. Elliott R, Zahn R, Deakin JFW, Anderson IM. 2011. Affective cognition and its disruption in mood disorders. Neuropsychopharmacology 36(1):153-82
50. EricksonK, DrevetsWC, Clark L, CannonDM, Bain EE, et al. 2005. Mood-congruent bias in affective go/nogo performance of unmedicated patients with major depressive disorder. Am. J. Psychiatry 162(11):2171-73
51. Fales CL, Barch DM, Rundle MM, Mintun MA, Snyder AZ, et al. 2008. Altered emotional interference processing in affective and cognitive-control brain circuitry in major depression. Biol. Psychiatry 63(4):377-84
52. Forbes EE, May JC, Siegle GJ, Ladouceur CD, Ryan ND, et al. 2006. Reward-related decision-making in pediatric major depressive disorder: An fMRI study. J. Child Psychol. Psychiatry 47(10):1031-40
53. Forbes EE, Hariri AR, Martin SL, Silk JS, Moyles DL, et al. 2009. Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. Am. J. Psychiatry 166(1):64-73
54. Ford DE, Kamerow DB. 1989. Epidemiologic study of sleep disturbances and psychiatric disorders: An opportunity for prevention? JAMA 262(11):1479-84
55. Frederick S, Loewenstein G. 1999. Hedonic adaptation. In Well-Being: The Foundations of a Hedonic Psychology, ed. E Diener, N Schwarz, pp. 302-29. New York: Russell Sage Found.
56. Fu CHY, Steiner H, Costafreda SG. 2013. Predictive neural biomarkers of clinical response in depression: A meta-analysis of functional and structural neuroimaging studies of pharmacological and psychological therapies. Neurobiol. Dis. 52:75-83
57. Gershman SJ, Markman AB, Otto AR. 2014. Retrospective revaluation in sequential decision making: A tale of two systems. J. Exp. Psychol. Gen. 143(1):182-94
58. Gotlib IH, Joormann J. 2010. Cognition and depression: current status and future directions. Annu. Rev. Clin. Psychol. 6:285-312
59. Gradin VB, Kumar P, Waiter G, Ahearn T, Stickle C, et al. 2011. Expected value and prediction error abnormalities in depression and schizophrenia. Brain 134(Part 6):1751-64
60. Gross JJ. 2002. Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology 39(3):281-91
61. Haeffel GJ. 2011. After further deliberation: Cognitive vulnerability predicts changes in event-specific negative inferences for a poor midterm grade. Cogn. Ther. Res. 35(4):285-92
62. Haeffel GJ, AbramsonLY, Brazy PC, Shah JY, Teachman BA, Nosek BA. 2007. Explicit and implicit cognition: A preliminary test of a dual-process theory of cognitive vulnerability to depression. Behav. Res. Ther. 45(6):1155-67
63. Harmer CJ, Goodwin GM, Cowen PJ. 2009. Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action. Br. J. Psychiatry 195(2):102-8
64. Hay N, Russell SJ. 2011. Metareasoning for Monte Carlo tree search. Tech. Rep., Electr. Eng. Comput. Sci., Univ. Calif., Berkeley
65. Holmes AJ, Pizzagalli DA. 2007. Task feedback effects on conflict monitoring and executive control: Relationship to subclinical measures of depression. Emotion 7(1):68-76
66. Huys QJM. 2007. Reinforcers and control: towards a computational ætiology of depression. PhD Thesis, Gatsby Comput. Neurosci. Unit, Univ. Coll. London, Univ. London
67. Huys QJM, Dayan P. 2009. A Bayesian formulation of behavioral control. Cognition 113(3):314-28
68. Huys QJM, Eshel N, O'Nions E, Sheridan L, Dayan P, Roiser JP. 2012. Bonsai trees in your head: how the Pavlovian system sculpts goal-directed choices by pruning decision trees. PLOS Comput. Biol. 8(3):e1002410
69. Huys QJM, Guitart-Masip M, Dolan RJ, Dayan P. 2015. Decision-theoretic psychiatry. Clin. Psychol. Sci. In press
70. Huys QJM, Pizzagalli DA, Bogdan R, Dayan P. 2013. Mapping anhedonia onto reinforcement learning: A behavioural meta-analysis. Biol. Mood Anxiety Disord. 3(1):12
71. Huys QJM, Tobler PN, HaslerG, Flagel SB. 2014. The role of learning-related dopamine signals in addiction vulnerability. Prog. Brain Res. 211:31-77
72. Huys QJM, Vogelstein J, Dayan P. 2009. Psychiatry: insights into depression through normative decisionmaking models. In Advances in Neural Information Processing Systems 21, ed. D Koller, D Schuurmans, Y Bengio, L Bottou, pp. 729-36. Cambridge, MA: MIT Press
73. Iacoviello BM, Alloy LB, Abramson LY, Choi JY. 2010. The early course of depression: A longitudinal investigation of prodromal symptoms and their relation to the symptomatic course of depressive episodes. J. Abnorm. Psychol. 119(3):459-67
74. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, et al. 2010. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 167(7):748-51
75. Johnson A, Redish AD. 2007. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27(45):12176-89
76. Joormann J. 2004. Attentional bias in dysphoria: the role of inhibitory processes. Cogn. Emot. 18(1):125-47
77. Joormann J. 2006. Differential effects of rumination and dysphoria on the inhibition of irrelevant emotional material: Evidence from a negative priming task. Cogn. Ther. Res. 30(2):149-60
78. Joormann J, Gotlib IH. 2008. Updating the contents of working memory in depression: interference from irrelevant negative material. J. Abnorm. Psychol. 117(1):182-92
79. Joormann J, Levens SM, Gotlib IH. 2011. Sticky thoughts: depression and rumination are associated with difficulties manipulating emotional material in working memory. Psychol. Sci. 22(8):979-83
80. Joormann J, Vanderlind WM. 2014. Emotion regulation in depression: the role of biased cognition and reduced cognitive control. Clin. Psychol. Sci. 2(4):402-21
81. Kellough JL, Beevers CG, Ellis AJ, Wells TT. 2008. Time course of selective attention in clinically depressed young adults: An eye tracking study. Behav. Res. Ther. 46(11):1238-43
82. Keramati M, Dezfouli A, Piray P. 2011. Speed/accuracy trade-off between the habitual and the goal-directed processes. PLOS Comput. Biol. 7(5):e1002055
83. Killcross S, Coutureau E. 2003. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 13(4):400-8
84. Knutson B, Bhanji JP, Cooney RE, Atlas LY, Gotlib IH. 2008. Neural responses to monetary incentives in major depression. Biol. Psychiatry 63(7):686-92
85. Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD. 2008. Abnormal temporal difference rewardlearning signals in major depression. Brain 131(Part 8):2084-93
86. Lamers F, de Jonge P, Nolen WA, Smit JH, Zitman FG, et al. 2010. Identifying depressive subtypes in a large cohort study: Results from theNetherlands Study of Depression and Anxiety (NESDA). J. Clin. Psychiatry 71(12):1582-89
87. Lautenbacher S, Roscher S, Strian D, Fassbender K, Krumrey K, Krieg J-C. 1994. Pain perception in depression: Relationships to symptomatology and naloxone-sensitive mechanisms. Psychosom. Med. 56:345-52
88. Lautenbacher S, Spernal J, Schreiber W, Krieg JC. 1999. Relationship between clinical pain complaints and pain sensitivity in patients with depression and panic disorder. Psychosom. Med. 61(6):822-27
89. Lawson C, MacLeod C, Hammond G. 2002. Interpretation revealed in the blink of an eye: depressive bias in the resolution of ambiguity. J. Abnorm. Psychol. 111(2):321-28
90. Leventhal AM, Chasson GS, Tapia E, Miller EK, Pettit JW. 2006. Measuring hedonic capacity in depression: A psychometric analysis of three anhedonia scales. J. Clin. Psychol. 62(12):1545-58
91. Lewinsohn P, Youngren M, Grosscup S. 1979. Reinforcement and depression. In The Psychobiology of Depressive Disorders: Implications for the Effects of Stress, ed. RA Depue, pp. 291-316. New York: Academic
92. Lieder F, Goodman N, Huys QJM. 2013. Learned helplessness and generalization. Proc. 35th Annu. Conf. Cogn. Sci. Soc., Berlin
93. Liverant GI, KamholzBW, SloanDM, BrownTA. 2011. Rumination in clinical depression: A type of emotional suppression? Cogn. Ther. Res. 35(3):253-65
94. López-Solà M, Pujol J, Hernández-Ribas R, Harrison BJ, Contreras-Rodŕ?guez O, et al. 2010. Effects of duloxetine treatment on brain response to painful stimulation in major depressive disorder. Neuropsychopharmacology 35(11):2305-17
95. Lyubomirsky S, Nolen-Hoeksema S. 1993. Self-perpetuating properties of dysphoric rumination. J. Personal. Soc. Psychol. 65(2):339-49
96. Maia TV, Frank MJ. 2011. From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 14(2):154-62
97. Maier SF, Amat J, Baratta MV, Paul E, Watkins LR. 2006. Behavioral control, the medial prefrontal cortex, and resilience. Dialogues Clin. Neurosci. 8(4):397-406
98. Maier SF, Watkins LR. 2005. Stressor controllability and learned helplessness: the roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor. Neurosci. Biobehav. Rev. 29(4-5):829-41
99. Marr D. 1982. Vision. New York: Freeman
100. Mathews A, MacLeod C. 2005. Cognitive vulnerability to emotional disorders. Annu. Rev. Clin. Psychol. 1:167-95
101. Mayberg HS. 2009. Targeted electrode-based modulation of neural circuits for depression. J. Clin. Investig. 119(4):717-25
102. Mazzoni P, Hristova A, Krakauer JW. 2007. Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. J. Neurosci. 27(27):7105-16
103. McGlinchey JB, Zimmerman M, Young D, Chelminski I. 2006. Diagnosing major depressive disorder VIII: Are some symptoms better than others? J. Nerv. Ment. Dis. 194(10):785-90
104. Mitchell AJ, McGlinchey JB, Young D, Chelminski I, Zimmerman M. 2009. Accuracy of specific symptoms in the diagnosis of major depressive disorder in psychiatric out-patients: data from the MIDAS project. Psychol. Med. 39(7):1107-16
105. Mogg K, Bradley BP, Williams R, Mathews A. 1993. Subliminal processing of emotional information in anxiety and depression. J. Abnorm. Psychol. 102(2):304-11
106. Montague PR, Dayan P, Sejnowski TJ. 1996. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16(5):1936-47
107. Montague PR, Dolan RJ, Friston KJ, Dayan P. 2012. Computational psychiatry. Trends Cogn. Sci. 16(1):72-80
108. Moulds ML, Kandris E, Starr S, Wong ACM. 2007. The relationship between rumination, avoidance and depression in a non-clinical sample. Behav. Res. Ther. 45(2):251-61
109. Murphy FC, Michael A, Robbins TW, Sahakian BJ. 2003. Neuropsychological impairment in patients with major depressive disorder: the effects of feedback on task performance. Psychol. Med. 33(3):455-67
110. Niv Y, Daw ND, Joel D, Dayan P. 2007. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191(3):507-20
111. Nolen-Hoeksema S. 1991. Responses to depression and their effects on the duration of depressive episodes. J. Abnorm. Psychol. 100(4):569-82
112. Nolen-Hoeksema S, Morrow J, Fredrickson BL. 1993. Response styles and the duration of episodes of depressed mood. J. Abnorm. Psychol. 102(1):20-28
113. Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. 2008. Rethinking rumination. Perspect. Psychol. Sci. 3(5):400-24
114. O'Doherty JP. 2011. Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann. N. Y. Acad. Sci. 1239:118-29
115. Pfeiffer BE, Foster DJ. 2013. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497(7447):74-79
116. Pizzagalli DA, Holmes AJ, Dillon DG, Goetz EL, Birk JL, et al. 2009. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am. J. Psychiatry 166(6):702-10
117. Pizzagalli DA, Jahn AL, O'Shea JP. 2005. Toward an objective characterization of an anhedonic phenotype: A signal-detection approach. Biol. Psychiatry 57(4):319-27
118. Ray RD, Ochsner KN, Cooper JC, Robertson ER, Gabrieli JDE, Gross JJ. 2005. Individual differences in trait rumination and the neural systems supporting cognitive reappraisal. Cogn. Affect. Behav. Neurosci. 5(2):156-68
119. Redish AD, Jensen S, Johnson A. 2008. A unified framework for addiction: vulnerabilities in the decision process. Behav. Brain Sci. 31(4):415-37; discuss. 437-87
120. Remijnse PL, Nielen MMA, van Balkom AJLM, Hendriks G-J, Hoogendijk WJ, et al. 2009. Differential frontal-striatal and paralimbic activity during reversal learning inmajor depressive disorder and obsessivecompulsive disorder. Psychol. Med. 39(9):1503-18
121. Robinson OJ, Cools R, Carlisi CO, Sahakian BJ, DrevetsWC. 2012. Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder. Am. J. Psychiatry 169(2):152-59
122. Rock PL, Roiser JP, Riedel WJ, Blackwell AD. 2014. Cognitive impairment in depression: A systematic review and meta-analysis. Psychol. Med. 44:2029-40
123. Roiser JP, Elliott R, Sahakian BJ. 2012. Cognitive mechanisms of treatment in depression. Neuropsychopharmacology 37(1):117-36
124. Rude SS, Valdez CR, Odom S, Ebrahimi A. 2003. Negative cognitive biases predict subsequent depression. Cogn. Ther. Res. 27(4):415-29
125. Savitz JB, DrevetsWC. 2013. Neuroreceptor imaging in depression. Neurobiol. Dis. 52:49-65
126. Schlagenhauf F, Huys QJM, Deserno L, Rapp MA, Beck A, et al. 2014. Striatal dysfunction during reversal learning in unmedicated schizophrenia patients. Neuroimage 89:171-80
127. Schwartz N, Temkin P, Jurado S, Lim BK, Heifets BD, et al. 2014. Decreased motivation during chronic pain requires long-term depression in the nucleus accumbens. Science 345(6196):535-42
128. Shah PJ, Ogilvie AD, Goodwin GM, Ebmeier KP. 1997. Clinical and psychometric correlates of dopamine D2 binding in depression. Psychol. Med. 27(6):1247-56
129. Siegle GJ, Steinhauer SR, Thase ME, Stenger VA, Carter CS. 2002. Can't shake that feeling: event-related fMRI assessment of sustained amygdala activity in response to emotional information in depressed individuals. Biol. Psychiatry 51(9):693-707
130. Sloan DM, Strauss ME, Quirk SW, Sajatovic M. 1997. Subjective and expressive emotional responses in depression. J. Affect. Disord. 46(2):135-41
131. Smoski MJ, Felder J, Bizzell J, Green SR, Ernst M, et al. 2009. fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder. J. Affect. Disord. 118(1-3):69-78
132. Stankevicius A, Huys QJM, Kalra A, Seriès P. 2014. Optimism as a prior belief about the probability of future reward. PLOS Comput. Biol. 10(5):e1003605
133. Steele JD, Kumar P, Ebmeier KP. 2007. Blunted response to feedback information in depressive illness. Brain 130(Part 9):2367-74
134. Steffens DC, Wagner HR, Levy RM, Horn KA, Krishnan KR. 2001. Performance feedback deficit in geriatric depression. Biol. Psychiatry 50(5):358-63
135. Sutton R. 1988. Learning to predict by the methods of temporal differences. Mach. Learn. 3(1):9-44
136. Sutton R. 1991. Dyna, an integrated architecture for learning, planning and reacting. Sigart Bull. 2:160-63
137. Taylor Tavares JV, Clark L, Furey ML, Williams GB, Sahakian BJ, Drevets WC. 2008. Neural basis of abnormal response to negative feedback in unmedicated mood disorders. Neuroimage 42(3):1118-26
138. Tobler PN, Fiorillo CD, Schultz W. 2005. Adaptive coding of reward value by dopamine neurons. Science 307(5715):1642-45
139. Tran TB, SiemerM, Joormann J. 2011. Implicit interpretation biases affect emotional vulnerability: A training study. Cogn. Emot. 25(3):546-58
140. Treadway MT, Zald DH. 2011. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev. 35(3):537-55
141. Tremblay LK, Naranjo CA, Cardenas L, HerrmannN, Busto UE. 2002. Probing brain reward system function in major depressive disorder: Altered response to dextroamphetamine. Arch. Gen. Psych. 59(5):209-15
142. Tremblay LK, Naranjo CA, Graham SJ, Herrmann N, Mayberg HS, et al. 2005. Functional neuroanatomical substrates of altered reward processing in major depressive disorder revealed by a dopaminergic probe. Arch. Gen. Psych. 62(11):1228-36
143. TreynorW, Gonzalez R, Nolen-Hoeksema S. 2003. Rumination reconsidered: A psychometric analysis. Cogn. Ther. Res. 27(3):247-59
144. Tye KM, Mirzabekov JJ, Warden MR, Ferenczi EA, Tsai H-C, et al. 2013. Dopamine neurons modulate neural encoding and expression of depression-related behaviour. Nature 493(7433):537-41
145. Watkins PC, Martin CK, Stern LD. 2000. Unconscious memory bias in depression: perceptual and conceptual processes. J. Abnorm. Psychol. 109(2):282-89
146. Weinstein ND. 1980. Unrealistic optimism about future life events. J. Personal. Soc. Psychol. 39(5):806-20
147. Weissmann AN, Beck AT. 1978. Development and validation of the Dysfunctional Attitudes Scale: A preliminary investigation. Presented at Annu. Meet. Am. Educ. Res. Assoc., Toronto
148. Wells A. 1999. A metacognitive model and therapy for generalized anxiety disorder. Clin. Psychol. Psychother. 6(2):86-95
149. Werner-Seidler A, Banks R, Dunn BD, Moulds ML. 2013. An investigation of the relationship between positive affect regulation and depression. Behav. Res. Ther. 51(1):46-56
150. Williams AD, Blackwell SE, Mackenzie A, Holmes EA, Andrews G. 2013. Combining imagination and reason in the treatment of depression: A randomized controlled trial of Internet-based cognitive-bias modification and Internet-CBT for depression. J. Consult. Clin. Psychol. 81(5):793-99
151. Williams JMG, Watts FN, MacLeod C, Mathews A. 1997. Cognitive Psychology and Emotional Disorders. Chichester, UK:Wiley. 2nd ed.
152. Williams JMG, Barnhofer T, Crane C, Herman D, Raes F, et al. 2007. Autobiographical memory specificity and emotional disorder. Psychol. Bull. 133(1):122-48
153. Williams KE, Chambless DL, Ahrens A. 1997. Are emotions frightening? An extension of the fear of fear construct. Behav. Res. Ther. 35(3):239-48
154. Willner P. 1985. Depression: A Psychobiological Synthesis. New York:Wiley
155. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y. 2014. Orbitofrontal cortex as a cognitive map of task space. Neuron 81(2):267-79
156. World Health Organ. 1990. The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Geneva:World Health Organ.
157. Xu J, Griffiths TL. 2010. A rational analysis of the effects of memory biases on serial reproduction. Cogn. Psychol. 60(2):107-26
158. Yu AJ, Dayan P, Cohen JD. 2009. Dynamics of attentional selection under conflict: toward a rational Bayesian account. J. Exp. Psychol. Hum. Percept. Perform. 35(3):700-17
159. Zhang W-N, Chang S-H, Guo L-Y, Zhang K-L, Wang J. 2013. The neural correlates of reward-related processing in major depressive disorder: A meta-analysis of functionalmagnetic resonance imaging studies. J. Affect. Disord. 151(2):531-39