Reinforcement learning in depression: A review of computational research

Neuroscience and Biobehavioral Reviews

Volumn 55, Issue , 2015, Pages 247-267

  Chen, Chong ^a   Takahashi, Taiki ^b   Nakagawa, Shin ^a   Inoue, Takeshi ^a,c   Kusumi, Ichiro ^a  

^a HOKKAIDO UNIVERSITY GRADUATE SCHOOL OF MEDICINE   (Japan)

^b HOKKAIDO UNIVERSITY   (Japan)

^c TOKYO MEDICAL UNIVERSITY   (Japan)

Author keywords

'Liking'; 'Wanting'; Anhedonia; Computational psychiatry; Depression; Dopamine; Incentive salience; Learning rate; Model based; Model free; Motivation; Prediction error; Reinforcement learning; Reward sensitivity; Stress

Indexed keywords

ANTIDEPRESSANT AGENT; ATYPICAL ANTIPSYCHOTIC AGENT; CITALOPRAM; DOPAMINE; DOPAMINE 2 RECEPTOR; DOPAMINE 3 RECEPTOR; MONOAMINE OXIDASE INHIBITOR; TRICYCLIC ANTIDEPRESSANT AGENT;

ADJUVANT THERAPY; ANHEDONIA; CONCEPTUAL FRAMEWORK; DEPRESSION; DOPAMINERGIC NERVE CELL; DOPAMINERGIC TRANSMISSION; ELECTROENCEPHALOGRAM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; LEARNING; MAJOR DEPRESSION; MELANCHOLIA; MOTIVATION; NEGATIVE FEEDBACK; NONHUMAN; POSITIVE FEEDBACK; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REINFORCEMENT LEARNING; REVIEW; REWARD; SUICIDAL IDEATION; SUICIDE ATTEMPT; TREATMENT RESISTANT DEPRESSION; VENTRAL TEGMENTUM; ANIMAL; BRAIN; COMPUTER SIMULATION; PATHOLOGY; PATHOPHYSIOLOGY; PSYCHOLOGY;

ANIMALS; BRAIN; COMPUTER SIMULATION; DEPRESSIVE DISORDER, MAJOR; HUMANS; MOTIVATION; REINFORCEMENT (PSYCHOLOGY);

EID: 84929583571     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2015.05.005     Document Type: Review

References (356)

1. Aggarwal M., Hyland B.I., Wickens J.R. Neural control of dopamine neurotransmission: implications for reinforcement learning. Eur. J. Neurosci. 2012, 35(7):1115-1123.
2. Agrawal A., Nelson E.C., Littlefield A.K., Bucholz K.K., Degenhardt L., Henders A.K., Madden P.A., Martin N.G., Montgomery G.W., Pergadia M.L., Sher K.J., Heath A.C., Lynskey M.T. Cannabinoid receptor genotype moderation of the effects of childhood physical abuse on anhedonia and depression. Arch. Gen. Psychiatry 2012, 69(7):732-740.
3. Ainsworth K., Smith S.E., Zetterström T.S., Pei Q., Franklin M., Sharp T. Effect of antidepressant drugs on dopamine D1 and D2 receptor expression and dopamine release in the nucleus accumbens of the rat. Psychopharmacology (Berlin) 1998, 140(4):470-477.
4. Akiskal H.S., Benazzi F. Atypical depression: a variant of bipolar II or a bridge between unipolar and bipolar II?. J. Affect. Disord. 2005, 84(2-3):209-217.
5. Alexander W.H., Brown J.W. Hyperbolically discounted temporal difference learning. Neural Comput. 2010, 22(6):1511-1527.
6. American Psychiatric Association The Fifth Edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) 2014, APA, Washington, DC.
7. Amsterdam J.D., Newberg A.B., Soeller I., Shults J. Greater striatal dopamine transporter density may be associated with major depressive episode. J. Affect. Disord. 2012, 141(2-3):425-431.
8. Antypa N., Drago A., Serretti A. The role of COMT gene variants in depression: bridging neuropsychological, behavioral and clinical phenotypes. Neurosci. Biobehav. Rev. 2013, 37(8):1597-1610.
9. Arnsten A.F. Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 2009, 10(6):410-422.
10. Aouizerate B., Cuny E., Bardinet E., Yelnik J., Martin-Guehl C., Rotge J.Y., Rougier A., Bioulac B., Tignol J., Mallet L., Burbaud P., Guehl D. Distinct striatal targets in treating obsessive-compulsive disorder and major depression. J. Neurosurg. 2009, 111(4):775-779.
11. Bäckman L., Lindenberger U., Li S.C., Nyberg L. Linking cognitive aging to alterations in dopamine neurotransmitter functioning: recent data and future avenues. Neurosci. Biobehav. Rev. 2010, 34(5):670-677.
12. Bahi A., Al Mansouri S., Al Memari E., Al Ameri M., Nurulain S.M., Ojha S. β-Caryophyllene, a CB2 receptor agonist produces multiple behavioral changes relevant to anxiety and depression in mice. Physiol. Behav. 2014, 135:119-124.
13. Bali A., Randhawa P.K., Jaggi A.S. Stress and opioids: role of opioids in modulating stress-related behavior and effect of stress on morphine conditioned place preference. Neurosci. Biobehav. Rev. 2015, 51C:138-150.
14. Balleine B.W. Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol. Behav. 2005, 86:717-730.
15. Bannon M.J. The dopamine transporter: role in neurotoxicity and human disease. Toxicol. Appl. Pharmacol. 2005, 204(3):355-360.
16. Barone P., Scarzella L., Marconi R., Antonini A., Morgante L., Bracco F., Zappia M., Musch B. Pramipexole versus sertraline in the treatment of depression in Parkinson's disease: a national multicenter parallel-group randomized study. J. Neurol. 2006, 253(5):601-607. Depression/Parkinson Italian Study Group.
17. Balleine B.W., O'Doherty J.P. Human and rodent homologies in motor control: cortico-striatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 5(1):48-69.
18. Baskin-Sommers A.R., Foti D. Abnormal reward functioning across substance use disorders and major depressive disorder: considering reward as a transdiagnostic mechanism. Int. J. Psychophysiol. 2015, (February). pii:S0167-8760(15)00028-8. 10.1016/j.ijpsycho.2015.01.011.
19. Beaulieu J.M., Gainetdinov R.R. The physiology, signaling, and pharmacology of dopamine receptors. Pharmacol. Rev. 2011, 63(1):182-217.
20. Beck A.T., Alford B.A. Depression: Causes and Treatment 2009, University of Pennsylvania Press, Philadelphia.
21. Belujon P., Grace A.A. Restoring mood balance in depression: ketamine reverses deficit in dopamine-dependent synaptic plasticity. Biol. Psychiatry 2014, 76(12):927-936.
22. Belzung C., Turiault M., Griebel G. Optogenetics to study the circuits of fear- and depression-like behaviors: a critical analysis. Pharmacol. Biochem. Behav. 2014, 122:144-157.
23. Belzung C., Willner P., Philippot P. Depression: from psychopathology to pathophysiology. Curr. Opin. Neurobiol. 2014, 30C:24-30.
24. Berg B.A., Schoenbaum G., McDannald M.A. The dorsal raphe nucleus is integral to negative prediction errors in Pavlovian fear. Eur. J. Neurosci. 2014, 10.1111/ejn.12676.
25. Bergfeld I.O., Mantione M., Hoogendoorn M.L., Denys D. Cognitive functioning in psychiatric disorders following deep brain stimulation. Brain Stimul. 2013, 6(4):532-537.
26. Berlim M.T., Van den Eynde F., Daskalakis Z.J. A systematic review and meta-analysis on the efficacy and acceptability of bilateral repetitive transcranial magnetic stimulation (rTMS) for treating major depression. Psychol. Med. 2013, 43(11):2245-2254.
27. Berlim M.T., van den Eynde F., Tovar-Perdomo S., Daskalakis Z.J. Response, remission and drop-out rates following high-frequency repetitive transcranial magnetic stimulation (rTMS) for treating major depression: a systematic review and meta-analysis of randomized, double-blind and sham-controlled trials. Psychol. Med. 2014, 44(2):225-239.
28. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berlin) 2007, 191:391-431.
29. Berridge K.C. From prediction error to incentive salience: mesolimbic computation of reward motivation. Eur. J. Neurosci. 2012, 35(7):1124-1143.
30. Berridge K.C., O'Doherty J.P. From experienced utility to decision utility. Neuroeconomics: Decisions and the Brain 2014, 335-354. Academic Press. 2nd ed. P. Glimcher, E. Fehr (Eds.).
31. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Rev. 1998, 28(3):309-369.
32. Berridge K.C., Robinson T.E., Aldridge J.W. Dissecting components of reward: 'liking', 'wanting', and learning. Curr. Opin. Pharmacol. 2009, 9(1):65-73.
33. Bershad A.K., Jaffe J.H., Childs E., de Wit H. Opioid partial agonist buprenorphine dampens responses to psychosocial stress in humans. Psychoneuroendocrinology 2015, 52:281-288.
34. Berton O., Hahn C.G., Thase M.E. Are we getting closer to valid translational models for major depression?. Science 2012, 338(6103):75-79.
35. Berton O., Nestler E.J. New approaches to antidepressant drug discovery: beyond monoamines. Nat. Rev. Neurosci. 2006, 7(2):137-151.
36. Bewernick B.H., Hurlemann R., Matusch A., Kayser S., Grubert C., Hadrysiewicz B., Axmacher N., Lemke M., Cooper-Mahkorn D., Cohen M.X., Brockmann H., Lenartz D., Sturm V., Schlaepfer T.E. Nucleus accumbens deep brain stimulation decreases ratings of depression and anxiety in treatment-resistant depression. Biol. Psychiatry 2010, 67(2):110-116.
37. Bewernick B.H., Kayser S., Sturm V., Schlaepfer T.E. Long-term effects of nucleus accumbens deep brain stimulation in treatment-resistant depression: evidence for sustained efficacy. Neuropsychopharmacology 2012, 37(9):1975-1985.
38. Blanco N.J., Otto A.R., Maddox W.T., Beevers C.G., Love B.C. The influence of depression symptoms on exploratory decision-making. Cognition 2013, 129(3):563-568.
39. Blier P., El Mansari M. Serotonin and beyond: therapeutics for major depression. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2013, 368(1615):20120536.
40. Bogdan R., Nikolova Y.S., Pizzagalli D.A. Neurogenetics of depression: a focus on reward processing and stress sensitivity. Neurobiol. Dis. 2013, 52:12-23.
41. Bornstein A.M., Daw N.D. Dissociating hippocampal and striatal contributions to sequential prediction learning. Eur. J. Neurosci. 2012, 35(7):1011-1023.
42. Boureau Y.L., Dayan P. Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 2011, 36(1):74-97.
43. Bress J.N., Foti D., Kotov R., Klein D.N., Hajcak G. Blunted neural response to rewards prospectively predicts depression in adolescent girls. Psychophysiology 2013, 50(1):74-81.
44. Brito N.H., Noble K.G. Socioeconomic status and structural brain development. Front. Neurosci. 2014, 8:276. 10.3389/fnins.2014.00276.
45. Brunoni A.R., Vanderhasselt M.A. Working memory improvement with non-invasive brain stimulation of the dorsolateral prefrontal cortex: a systematic review and meta-analysis. Brain Cogn. 2014, 86:1-9.
46. Brunswick D.J., Amsterdam J.D., Mozley P.D., Newberg A. Greater availability of brain dopamine transporters in major depression shown by [99m Tc]TRODAT-1 SPECT imaging. Am. J. Psychiatry 2003, 160(10):1836-1841.
47. Burnett F.E., Scott L.V., Weaver M.G., Medbak S.H., Dinan T.G. The effect of naloxone on adrenocorticotropin and cortisol release: evidence for a reduced response in depression. J. Affect. Disord. 1999, 53(3):263-268.
48. Burokas A., Martín-García E., Gutiérrez-Cuesta J., Rojas S., Herance J.R., Gispert J.D., Serra M.Á., Maldonado R. Relationships between serotonergic and cannabinoid system in depressive-like behavior: a PET study with [11C]-DASB. J. Neurochem. 2014, 130(1):126-135.
49. Buschman T.J., Miller E.K. Goal-direction and top-down control. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2014, 369(1655):20130471.
50. Cabib S., Puglisi-Allegra S. The mesoaccumbens dopamine in coping with stress. Neurosci. Biobehav. Rev. 2012, 36(1):79-89.
51. Caldarone B.J., Zachariou V., King S.L. Rodent models of treatment-resistant depression. Eur. J. Pharmacol. 2015, 753:51-65.
52. Cassano P., Lattanzi L., Soldani F., Navari S., Battistini G., Gemignani A., Cassano G.B. Pramipexole in treatment-resistant depression: an extended follow-up. Depress. Anxiety 2004, 20(3):131-138.
53. Castro D.C., Berridge K.C. Advances in the neurobiological bases for food 'liking' versus 'wanting'. Physiol. Behav. 2014, pii:S0031-9384(14)00299-6. 10.1016/j.physbeh.2014.05.022.
54. Chamberlain S.R., Robbins T.W. Noradrenergic modulation of cognition: therapeutic implications. J. Psychopharmacol. 2013, 27(8):694-718.
55. Chase H.W., Frank M.J., Michael A., Bullmore E.T., Sahakian B.J., Robbins T.W. Approach and avoidance learning in patients with major depression and healthy controls: relation to anhedonia. Psychol. Med. 2010, 40(3):433-440.
56. Chase H.W., Kumar P., Eickhoff S.B., Dombrovski A.Y. Reinforcement learning models and their neural correlates: an activation likelihood estimation meta-analysis. Cogn. Affect. Behav. Neurosci. 2015, 10.3758/s13415-015-0338-7.
57. Chatham C., Frank M.J., Badre D. Corticostriatal output gating during selection from working memory. Neuron 2014, 81:930-942.
58. Chaudhry F.A., Edwards R.H., Fonnum F. Vesicular neurotransmitter transporters as targets for endogenous and exogenous toxic substances. Annu. Rev. Pharmacol. Toxicol. 2008, 48:277-301.
59. Chaudhury D., Walsh J.J., Friedman A.K., Juarez B., Ku S.M., Koo J.W., Ferguson D., Tsai H.C., Pomeranz L., Christoffel D.J., Nectow A.R., Ekstrand M., Domingos A., Mazei-Robison M.S., Mouzon E., Lobo M.K., Neve R.L., Friedman J.M., Russo S.J., Deisseroth K., Nestler E.J., Han M.H. Rapid regulation of depression-related behaviours by control of midbrain dopamine neurons. Nature 2013, 493(7433):532-536.
60. Chen C. Intelligence moderates reinforcement learning: a mini-review of the neural evidence. J. Neurophysiol. 2014, (Published online: 3 September 2014). 10.1152/jn.00600.2014.
61. Chen C., Omiya Y., Yang S. Dissociating contributions of ventral and dorsal striatum to reward learning. J. Neurophysiol. 2014, 10.1152/jn.00873.2014(Published online: 19 November 2014).
62. Chernoloz O., El Mansari M., Blier P. Long-term administration of the dopamine D3/2 receptor agonist pramipexole increases dopamine and serotonin neurotransmission in the male rat forebrain. J. Psychiatry Neurosci. 2012, 37(2):113-121.
63. Chiuccariello L., Houle S., Miler L., Cooke R.G., Rusjan P.M., Rajkowska G., Levitan R.D., Kish S.J., Kolla N.J., Ou X., Wilson A.A., Meyer J.H. Elevated monoamine oxidase a binding during major depressive episodes is associated with greater severity and reversed neurovegetative symptoms. Neuropsychopharmacology 2014, 39(4):973-980.
64. Chowdhury R., Guitart-Masip M., Lambert C., Dayan P., Huys Q., Duzel E., Dolan R. Dopamine restores reward prediction errors in old age. Nat. Neurosci. 2013, 16:648-653.
65. Clark L., Chamberlain S.R., Sahakian B.J. Neurocognitive mechanisms in depression: implications for treatment. Annu. Rev. Neurosci. 2009, 32:57-74.
66. Cohen M.X. Individual differences and the neural representations of reward expectation and reward prediction error. Soc. Cogn. Affect. Neurosci. 2007, 2(1):20-30.
67. Costa V.D., Tran V.L., Turchi J., Averbeck B.B. Reversal learning and dopamine: a Bayesian perspective. J. Neurosci. 2015, 35(6):2407-2416.
68. Covington H.E., Lobo M.K., Maze I., Vialou V., Hyman J.M., Zaman S., et al. Antidepressant effect of optogenetic stimulation of the medial prefrontal cortex. J. Neurosci. 2010, 30:16082-16090.
69. Cusin C., Iovieno N., Iosifescu D.V., Nierenberg A.A., Fava M., Rush A.J., Perlis R.H. A randomized, double-blind, placebo-controlled trial of pramipexole augmentation in treatment-resistant major depressive disorder. J. Clin. Psychiatry 2013, 74(7):e636-e641.
70. Daw N.D. Advanced reinforcement learning. Neuroeconomics: Decision Making and the Brain 2013, 299-320. Elsevier, San Diego. 2nd ed. P. Glimcher, E. Fehr (Eds.).
71. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69(6):1204-1215.
72. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8(12):1704-1711.
73. Daw N.D., O'Doherty J.P. Multiple systems for value learning. Neuroeconomics: Decision Making and the Brain 2013, 393-410. Elsevier, San Diego. 2nd ed. P. Glimcher, E. Fehr (Eds.).
74. Daw N.D., Tobler P. Value learning through reinforcement: the basics of dopamine and reinforcement learning. Neuroeconomics: Decision Making and the Brain 2013, 283-298. Elsevier, San Diego. 2nd ed. P. Glimcher, E. Fehr (Eds.).
75. Dayan P. Goal-directed control and its antipodes. Neural Netw. 2009, 22:213-219.
76. Dayan P., Huys Q.J. Serotonin in affective control. Annu. Rev. Neurosci. 2009, 32:95-126.
77. Deakin J. The origins of '5-HT and mechanisms of defence' by Deakin and Graeff: a personal perspective. J. Psychopharmacol. 2013, 27(12):1084-1089.
78. de Kloet E.R., Joëls M., Holsboer F. Stress and the brain: from adaptation to disease. Nat. Rev. Neurosci. 2005, 6(6):463-475.
79. Delgado M.R., Li J., Schiller D., Phelps E.A. The role of the striatum in aversive learning and aversive prediction errors. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2008, 363(1511):3787-3800.
80. Der-Avakian A., Markou A. The neurobiology of anhedonia and other reward-related deficits. Trends Neurosci. 2012, 35(1):68-77.
81. de Wit S., Watson P., Harsay H.A., Cohen M.X., van de Vijver I., Ridderinkhof K.R. Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control. J. Neurosci. 2012, 32(35):12066-12075.
82. Dickinson A., Charnock D.J. Contingency effects with maintained instrumental reinforcement. Q. J. Exp. Psychol. B 1985, 37:397-416.
83. Dillon D.G., Dobbins I.G., Pizzagalli D.A. Weak reward source memory in depression reflects blunted activation of VTA/SN and parahippocampus. Soc. Cogn. Affect. Neurosci. 2014, 9(10):1576-1583.
84. Dimidjian S., Barrera M., Martell C., Muñoz R.F., Lewinsohn P.M. The origins and current status of behavioral activation treatments for depression. Annu. Rev. Clin. Psychol. 2011, 7:1-38.
85. Dolan R.J., Dayan P. Goals and habits in the brain. Neuron 2013, 80(2):312-325.
86. Doll B.B., Simon D.A., Daw N.D. The ubiquity of model-based reinforcement learning. Curr. Opin. Neurobiol. 2012, 22(6):1075-1081.
87. Dombrovski A.Y., Clark L., Siegle G.J., Butters M.A., Ichikawa N., Sahakian B.J., Szanto K. Reward/Punishment reversal learning in older suicide attempters. Am. J. Psychiatry 2010, 167(6):699-707.
88. Dombrovski A.Y., Szanto K., Clark L., Aizenstein H.J., Chase H.W., Reynolds C.F., Siegle G.J. Corticostriatothalamic reward prediction error signals and executive control in late-life depression. Psychol. Med. 2014, (Published online: 16 October 2014). 10.1017/S0033291714002517.
89. Dombrovski A.Y., Szanto K., Clark L., Reynolds C.F., Siegle G.J. Reward signals, attempted suicide, and impulsivity in late-life depression. JAMA Psychiatry 2013, 10.1001/jamapsychiatry.2013.75.
90. Dombrovski A.Y., Szanto K., Siegle G.J., Wallace M.L., Forman S.D., Sahakian B., Reynolds C.F., Clark L. Lethal forethought: delayed reward discounting differentiates high- and low-lethality suicide attempts in old age. Biol. Psychiatry 2011, 70(2):138-144.
91. Domschke K., Dannlowski U., Ohrmann P., Lawford B., Bauer J., Kugel H., Heindel W., Young R., Morris P., Arolt V., Deckert J., Suslow T., Baune B.T. Cannabinoid receptor 1 (CNR1) gene: impact on antidepressant treatment response and emotion processing in major depression. Eur. Neuropsychopharmacol. 2008, 18(10):751-759.
92. Downar J., Geraci J., Salomons T.V., Dunlop K., Wheeler S., McAndrews M.P., Bakker N., Blumberger D.M., Daskalakis Z.J., Kennedy S.H., Flint A.J., Giacobbe P. Anhedonia and reward-circuit connectivity distinguish nonresponders from responders to dorsomedial prefrontal repetitive transcranial magnetic stimulation in major depression. Biol. Psychiatry 2014, 76(3):176-185.
93. Doya K. Modulators of decision making. Nat. Neurosci. 2008, 11(4):410-416.
94. Duncan J., Johnson S., Ou X.M. Monoamine oxidases in major depressive disorder and alcoholism. Drug Discov. Ther. 2012, 6(3):112-122.
95. Dunlop B.W., Nemeroff C.B. The role of dopamine in the pathophysiology of depression. Arch. Gen. Psychiatry 2007, 64(3):327-337.
96. Dunlop B.W., Nemeroff C.B. The role of dopamine in the pathophysiology and treatment of major depressive disorder. Dopamine Handbook 2010, 572-589. Oxford University Press, Inc., New York. L. Iversen, S. Iversen, S. Dunnett, A. Bjorklund (Eds.).
97. Dzirasa K., Covington H.E. Increasing the validity of experimental models for depression. Ann. N. Y. Acad. Sci. 2012, 1265:36-45.
98. Epstein S. Integration of the cognitive and the psychodynamic unconscious. Am. Psychol. 1994, 49:709-724.
99. Eriksen J., Jørgensen T.N., Gether U. Regulation of dopamine transporter function by protein-protein interactions: new discoveries and methodological challenges. J. Neurochem. 2010, 113(1):27-41.
100. Eshel N., Roiser J.P. Reward and punishment processing in depression. Biol. Psychiatry 2010, 68(2):118-124.
101. Fan Y., Chen P., Li Y., Zhu M.Y. Effects of chronic social defeat on expression of dopamine β-hydroxylase in rat brains. Synapse 2013, 67(6):300-312.
102. Favier M., Duran T., Carcenac C., Drui G., Savasta M., Carnicella S. Pramipexole reverses Parkinson's disease-related motivational deficits in rats. Mov. Disord. 2014, 29(7):912-920.
103. Finberg J.P. Update on the pharmacology of selective inhibitors of MAO-A and MAO-B: focus on modulation of CNS monoamine neurotransmitter release. Pharmacol. Ther. 2014, 143(2):133-152.
104. Forbes E.E., Dahl R.E. Research Review: altered reward function in adolescent depression: what, when and how?. J. Child Psychol. Psychiatry 2012, 53(1):3-15.
105. Forbes E.E., Olino T.M., Ryan N.D., Birmaher B., Axelson D., Moyles D.L., Dahl R.E. Reward-related brain function as a predictor of treatment response in adolescents with major depressive disorder. Cogn. Affect. Behav. Neurosci. 2010, 10(1):107-118.
106. Ford C.P. The role of D2-autoreceptors in regulating dopamine neuron activity and transmission. Neuroscience 2014, 282C:13-22.
107. Franco-Chaves J.A., Mateus C.F., Luckenbaugh D.A., Martinez P.E., Mallinger A.G., Zarate C.A. Combining a dopamine agonist and selective serotonin reuptake inhibitor for the treatment of depression: a double-blind, randomized pilot study. J. Affect. Disord. 2013, 149(1-3):319-325.
108. Frank M.J., Claus E.D. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making and reversal. Psychol. Rev. 2006, 113:300-326.
109. Friedel E., Schlagenhauf F., Beck A., Dolan R.J., Huys Q.J.M., Rapp M.A., Heinz A. The effects of life stress and neural learning signals on fluid intelligence. Eur. Arch. Psychiatry Clin. Neurosci. 2014, (Published online: 21 Aug 2014).
110. Friedman A., Frankel M., Flaumenhaft Y., Merenlender A., Pinhasov A., Feder Y., Taler M., Gil-Ad I., Abeles M., Yadid G. Programmed acute electrical stimulation of ventral tegmental area alleviates depressive-like behavior. Neuropsychopharmacology 2009, 34(4):1057-1066.
111. Friedman A., Friedman Y., Dremencov E., Yadid G. VTA dopamine neuron bursting is altered in an animal model of depression and corrected by desipramine. J. Mol. Neurosci. 2008, 34(3):201-209.
112. Friedman A., Lax E., Abraham L., Tischler H., Yadid G. Abnormality of VTA local field potential in an animal model of depression was restored by patterned DBS treatment. Eur. Neuropsychopharmacol. 2012, 22(1):64-71.
113. Friedman A.K., Walsh J.J., Juarez B., Ku S.M., Chaudhury D., Wang J., Li X., Dietz D.M., Pan N., Vialou V.F., Neve R.L., Yue Z., Han M.H. Enhancing depression mechanisms in midbrain dopamine neurons achieves homeostatic resilience. Science 2014, 344(6181):313-319.
114. García-Gutiérrez M.S., Pérez-Ortiz J.M., Gutiérrez-Adán A., Manzanares J. Depression-resistant endophenotype in mice overexpressing cannabinoid CB(2) receptors. Br. J. Pharmacol. 2010, 160(7):1773-1784.
115. Garrison J., Erdeniz B., Done J. Prediction error in reinforcement learning: a meta-analysis of neuroimaging studies. Neurosci. Biobehav. Rev. 2013, 37(7):1297-1310.
116. Gaynes B.N., Lloyd S.W., Lux L., Gartlehner G., Hansen R.A., Brode S., Jonas D.E., Swinson Evans T., Viswanathan M., Lohr K.N. Repetitive transcranial magnetic stimulation for treatment-resistant depression: a systematic review and meta-analysis. J. Clin. Psychiatry 2014, 75(5):477-489.
117. Gazit T., Friedman A., Lax E., Samuel M., Zahut R., Katz M., Abraham L., Tischler H., Teicher M., Yadid G. Programmed deep brain stimulation synchronizes VTA gamma band field potential and alleviates depressive-like behavior in rats. Neuropharmacology 2015, 91:135-141.
118. Gerfen C.R., Surmeier D.J. Modulation of striatal projection systems by dopamine. Annu. Rev. Neurosci. 2011, 34:441-466.
119. Gershon A.A., Vishne T., Grunhaus L. Dopamine D2-like receptors and the antidepressant response. Biol. Psychiatry 2007, 61(2):145-153.
120. Gersner R., Toth E., Isserles M., Zangen A. Site-specific antidepressant effects of repeated subconvulsive electrical stimulation: potential role of brain-derived neurotrophic factor. Biol. Psychiatry 2010, 67(2):125-132.
121. Gillies G.E., Virdee K., McArthur S., Dalley J.W. Sex-dependent diversity in ventral tegmental dopaminergic neurons and developmental programing: a molecular, cellular and behavioral analysis. Neuroscience 2014, 282C:69-85.
122. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66(4):585-595.
123. Glimcher P.W. Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc. Natl. Acad. Sci. U.S.A. 2011, 108(Suppl. 3):15647-15654.
124. Glimcher P., Fehr E. Neuroeconomics: Decision Making and the Brain 2013, Elsevier, San Diego. 2nd ed.
125. Goldwater D.S., Pavlides C., Hunter R.G., Bloss E.B., Hof P.R., McEwen B.S., Morrison J.H. Structural and functional alterations to rat medial prefrontal cortex following chronic restraint stress and recovery. Neuroscience 2009, 164(2):798-808.
126. Gorzalka B.B., Hill M.N. Putative role of endocannabinoid signaling in the etiology of depression and actions of antidepressants. Prog. Neuropsychopharmacol. Biol. Psychiatry 2011, 35(7):1575-1585.
127. Gotlib I.H., Hammen C.L. Handbook of Depression 2014, Guilford Press, New York. 3rd ed.
128. Gotlib I.H., Joormann J. Cognition and depression: current status and future directions. Annu. Rev. Clin. Psychol. 2010, 6:285-312.
129. Gottesman I.I., Gould T.D. The endophenotype concept in psychiatry: etymology and strategic intentions. Am. J. Psychiatry 2003, 160(4):636-645.
130. Gradin V.B., Kumar P., Waiter G., Ahearn T., Stickle C., Milders M., Reid I., Hall J., Steele J.D. Expected value and prediction error abnormalities in depression and schizophrenia. Brain 2011, 134(6):1751-1764.
131. Haber S.N. The place of dopamine in the cortico-basal ganglia circuit. Neuroscience 2014, 282C:248-257.
132. Haber S.N., Behrens T.E. The neural network underlying incentive-based learning: implications for interpreting circuit disruptions in psychiatric disorders. Neuron 2014, 83(5):1019-1039.
133. Haber S.N., Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 2010, 35(1):4-26.
134. Hajcak G., Moser J.S., Yeung N., Simons R.F. On the ERN and the significance of errors. Psychophysiology 2005, 42(2):151-160.
135. Hamani C., Amorim B.O., Wheeler A.L., Diwan M., Driesslein K., Covolan L., Butson C.R., Nobrega J.N. Deep brain stimulation in rats: different targets induce similar antidepressant-like effects but influence different circuits. Neurobiol. Dis. 2014, 71:205-214.
136. Hamani C., Diwan M., Macedo C.E., Brandão M.L., Shumake J., Gonzalez-Lima F., Raymond R., Lozano A.M., Fletcher P.J., Nobrega J.N. Antidepressant-like effects of medial prefrontal cortex deep brain stimulation in rats. Biol. Psychiatry 2010, 67(2):117-124.
137. Hamani C., Machado D.C., Hipólide D.C., Dubiela F.P., Suchecki D., Macedo C.E., Tescarollo F., Martins U., Covolan L., Nobrega J.N. Deep brain stimulation reverses anhedonic-like behavior in a chronic model of depression: role of serotonin and brain derived neurotrophic factor. Biol. Psychiatry 2012, 71(1):30-35.
138. Hammen C. Stress and depression. Annu. Rev. Clin. Psychol. 2005, 1:293-319.
139. Han R., Takahashi T. Psychophysics of time perception and valuation in temporal discounting of gain and loss. Physica A 2012, 391(24):6568-6576.
140. Hasler G. Can the neuroeconomics revolution revolutionize psychiatry?. Neurosci. Biobehav. Rev. 2012, 36(1):64-78.
141. Henn F.A., Vollmayr B. Stress models of depression: forming genetically vulnerable strains. Neurosci. Biobehav. Rev. 2005, 29(4-5):799-804.
142. Hill M.N., Carrier E.J., McLaughlin R.J., Morrish A.C., Meier S.E., Hillard C.J., Gorzalka B.B. Regional alterations in the endocannabinoid system in an animal model of depression: effects of concurrent antidepressant treatment. J. Neurochem. 2008, 106(6):2322-2336.
143. Hill M.N., Hillard C.J., Bambico F.R., Patel S., Gorzalka B.B., Gobbi G. The therapeutic potential of the endocannabinoid system for the development of a novel class of antidepressants. Trends Pharmacol. Sci. 2009, 30(9):484-493.
144. Hirvonen J., Hietala J., Kajander J., Markkula J., Rasi-Hakala H., Salminen J.K., Någren K., Aalto S., Karlsson H. Effects of antidepressant drug treatment and psychotherapy on striatal and thalamic dopamine D2/3 receptors in major depressive disorder studied with [11C]raclopride PET. J. Psychopharmacol. 2011, 25(10):1329-1336.
145. Holroyd C.B., Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 2002, 109(4):679-709.
146. Holtzheimer P.E., Kelley M.E., Gross R.E., Filkowski M.M., Garlow S.J., Barrocas A., Wint D., Craighead M.C., Kozarsky J., Chismar R., Moreines J.L., Mewes K., Posse P.R., Gutman D.A., Mayberg H.S. Subcallosal cingulate deep brain stimulation for treatment-resistant unipolar and bipolar depression. Arch. Gen. Psychiatry 2012, 69(2):150-158.
147. Howlett J.R., Paulus M.P. Decision-making dysfunctions of counterfactuals in depression: who might I have been?. Front Psychiatry 2013, 4:143. (eCollection 2013). 10.3389/fpsyt.2013.00143.
148. Hsiao M.C., Lin K.J., Liu C.Y., Schatz D.B. The interaction between dopamine transporter function, gender differences, and possible laterality in depression. Psychiatry Res. 2013, 211(1):72-77.
149. Huettel S.A. Event-related fMRI in cognition. Neuroimage 2012, 62(2):1152-1156.
150. Huys Q.J.M., Daw N.D., Dayan P. Depression: a decision theoretic analysis. Annu. Rev. Neurosci. 2015, 38. (Author's proof).
151. Huys Q.J., Moutoussis M., Williams J. Are computational models of any use to psychiatry?. Neural Netw. 2011, 24(6):544-551.
152. Huys Q.J., Pizzagalli D.A., Bogdan R., Dayan P. Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis. Biol. Mood Anxiety Disord. 2013, 3(1):12.
153. Inoue T., Kitaichi Y., Masui T., Nakagawa S., Boku S., Tanaka T., Suzuki K., Nakato Y., Usui R., Koyama T., et al. Pramipexole for stage 2 treatment-resistant major depression: an open study. Prog. Neuropsychopharmacol. Biol. Psychiatry 2010, 34(8):1446-1449.
154. Jackson F., Nelson B.D., Proudfit G.H. In an uncertain world, errors are more aversive: evidence from the error-related negativity. Emotion 2015, 15(1):12-16.
155. Jocham G., Klein T.A., Ullsperger M. Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J. Neurosci. 2011, 31(5):1606-1613.
156. Juhasz G., Chase D., Pegg E., Downey D., Toth Z.G., Stones K., Platt H., Mekli K., Payton A., Elliott R., Anderson I.M., Deakin J.F. CNR1 gene is associated with high neuroticism and low agreeableness and interacts with recent negative life events to predict current depressive symptoms. Neuropsychopharmacology 2009, 34(8):2019-2027.
157. Kahneman D. Thinking, Fast and Slow 2011, Farrar, Straus and Giroux, New York.
158. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47(2):263-291.
159. Kanter J.W., Manos R.C., Bowe W.M., Baruch D.E., Busch A.M., Rusch L.C. What is behavioral activation? A review of the empirical literature. Clin. Psychol. Rev. 2010, 30(6):608-620.
160. Kapur S., Mann J.J. Role of the dopaminergic system in depression. Biol. Psychiatry 1992, 32(1):1-17.
161. Karhunen T., Tilgmann C., Ulmanen I., Panula P. Catechol-O-methyltransferase (COMT) in rat brain: immunoelectron microscopic study with an antiserum against rat recombinant COMT protein. Neurosci. Lett. 1995, 187(1):57-60.
162. Kato M., Chang C.M. Augmentation treatments with second-generation antipsychotics to antidepressants in treatment-resistant depression. CNS Drugs 2013, 27(Suppl. 1):S11-S19.
163. Kennedy S.E., Koeppe R.A., Young E.A., Zubieta J.K. Dysregulation of endogenous opioid emotion regulation circuitry in major depression in women. Arch. Gen. Psychiatry 2006, 63(11):1199-1208.
164. Kennedy S.H., Giacobbe P., Rizvi S.J., Placenza F.M., Nishikawa Y., Mayberg H.S., Lozano A.M. Deep brain stimulation for treatment-resistant depression: follow-up after 3 to 6 years. Am. J. Psychiatry 2011, 168(5):502-510.
165. Kerestes R., Davey C.G., Stephanou K., Whittle S., Harrison B.J. Functional brain imaging studies of youth depression: a systematic review. Neuroimage Clin. 2014, 4:209-231.
166. Knutson B., Bhanji J.P., Cooney R.E., Atlas L.Y., Gotlib I.H. Neural responses to monetary incentives in major depression. Biol. Psychiatry 2008, 63(7):686-692.
167. Knutson B., Heinz A. Probing psychiatric symptoms with the monetary incentive delay task. Biol. Psychiatry 2015, 77(5):418-420.
168. Kocabas N.A. Catechol-O-methyltransferase (COMT) pharmacogenetics in the treatment response phenotypes of major depressive disorder (MDD). CNS Neurol. Disord. Drug Targets 2012, 11(3):264-272.
169. Koob G., Kreek M.J. Stress, dysregulation of drug reward pathways, and the transition to drug dependence. Am. J. Psychiatry 2007, 164(8):1149-1159.
170. Kruk-Slomka M., Michalak A., Biala G. Antidepressant-like effects of the cannabinoid receptor ligands in the forced swimming test in mice: mechanism of action and possible interactions with cholinergic system. Behav. Brain Res. 2015, 284C:24-36.
171. Kumar P., Waiter G., Ahearn T., Milders M., Reid I., Steele J.D. Abnormal temporal difference reward-learning signals in major depression. Brain 2008, 131(Pt 8):2084-2093.
172. Laasonen-Balk T., Kuikka J., Viinamäki H., Husso-Saastamoinen M., Lehtonen J., Tiihonen J. Striatal dopamine transporter density in major depression. Psychopharmacology (Berlin) 1999, 144(3):282-285.
173. Lam R.W., Stewart J.N. The validity of atypical depression in DSM-IV. Compr. Psychiatry 1996, 37(6):375-383.
174. Lammers C.H., Diaz J., Schwartz J.C., Sokoloff P. Selective increase of dopamine D3 receptor gene expression as a common effect of chronic antidepressant treatments. Mol. Psychiatry 2000, 5(4):378-388.
175. Lammel S., Lim B.K., Ran C., Huang K.W., Betley M.J., Tye K.M., Deisseroth K., Malenka R.C. Input-specific control of reward and aversion in the ventral tegmental area. Nature 2012, 491(7423):212-217.
176. Landauer T.K. Reinforcement as consolidation. Psychol. Rev. 1969, 76(1):82-96.
177. Larsen T., O'Doherty J.P. Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: a combined fMRI-EEG study. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2014, 369(1655):20130473.
178. Lecca S., Meye F.J., Mameli M. The lateral habenula in addiction and depression: an anatomical, synaptic and behavioral overview. Eur. J. Neurosci. 2014, 39(7):1170-1178.
179. Lee D. Decision making: from neuroscience to psychiatry. Neuron 2013, 78:233-248.
180. Lee D., Seo H., Jung M.W. Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 2012, 35:287-308.
181. Lee R.S., Hermens D.F., Porter M.A., Redoblado-Hodge M.A. A meta-analysis of cognitive deficits in first-episode Major Depressive Disorder. J. Affect. Disord. 2012, 140(2):113-124.
182. Leentjens A.F. The role of dopamine agonists in the treatment of depression in patients with Parkinson's disease: a systematic review. Drugs 2011, 71(3):273-286.
183. Li Y., Zhu Z.R., Ou B.C., Wang Y.Q., Tan Z.B., Deng C.M., Gao Y.Y., Tang M., So J.H., Mu Y.L., Zhang L.Q. Dopamine D2/D3 but not dopamine D1 receptors are involved in the rapid antidepressant-like effects of ketamine in the forced swim test. Behav. Brain Res. 2015, 279:100-105.
184. Liljeholm M., O'Doherty J.P. Contributions of the striatum to learning, motivation, 205 and performance: an associative account. Trends Cogn. Sci. 2012, 16(9):467-475.
185. Liu Y., Edwards R.H. The role of vesicular transport proteins in synaptic transmission and neural degeneration. Annu. Rev. Neurosci. 1997, 20:125-156.
186. Lowry C.A., Hale M.W., Evans A.K., Heerkens J., Staub D.R., Gasser P.J., Shekhar A. Serotonergic systems, anxiety, and affective disorder: focus on the dorsomedial part of the dorsal raphe nucleus. Ann. N. Y. Acad. Sci. 2008, 1148:86-94.
187. Lozano A.M., Giacobbe P., Hamani C., Rizvi S.J., Kennedy S.H., Kolivakis T.T., Debonnel G., Sadikot A.F., Lam R.W., Howard A.K., Ilcewicz-Klimek M., Honey C.R., Mayberg H.S. A multicenter pilot study of subcallosal cingulate area deep brain stimulation for treatment-resistant depression. J. Neurosurg. 2012, 116(2):315-322.
188. Lozano A.M., Mayberg H.S., Giacobbe P., Hamani C., Craddock R.C., Kennedy S.H. Subcallosal cingulate gyrus deep brain stimulation for treatment-resistant depression. Biol. Psychiatry 2008, 64(6):461-467.
189. Lupien S.J., McEwen B.S., Gunnar M.R., Heim C. Effects of stress throughout the lifespan on the brain, behaviour and cognition. Nat. Rev. Neurosci. 2009, 10(6):434-445.
190. Lutz P.E., Kieffer B.L. Opioid receptors: distinct roles in mood disorders. Trends Neurosci. 2013, 36(3):195-206.
191. Maddox W.T., Chandrasekaran B., Smayda K., Yi H.G., Koslov S., Beevers C.G. Elevated depressive symptoms enhance reflexive but not reflective auditory category learning. Cortex 2014, 58:186-198.
192. Maia T.V., Frank M.J. From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 2011, 14:154-162.
193. Maier S., Seligman M. Learned helplessness: theory and evidence. J. Exp. Psychol.: Gen. 1976, 105(1):3-46.
194. Maier S.F., Watkins L.R. Stressor controllability and learned helplessness: the roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor. Neurosci. Biobehav. Rev. 2005, 29(4-5):829-841.
195. Maj J., Rogóz Z. Synergistic effect of pramipexole and sertraline in the forced swimming test. Pol. J. Pharmacol. 1999, 51(6):471-475.
196. Malone D.A., Dougherty D.D., Rezai A.R., Carpenter L.L., Friehs G.M., Eskandar E.N., Rauch S.L., Rasmussen S.A., Machado A.G., Kubu C.S., Tyrka A.R., Price L.H., Stypulkowski P.H., Giftakis J.E., Rise M.T., Malloy P.F., Salloway S.P., Greenberg B.D. Deep brain stimulation of the ventral capsule/ventral striatum for treatment-resistant depression. Biol. Psychiatry 2009, 65(4):267-275.
197. Männistö P.T., Kaakkola S. Catechol-O-methyltransferase (COMT): biochemistry, molecular biology, pharmacology, and clinical efficacy of the new selective COMT inhibitors. Pharmacol. Rev. 1999, 51(4):593-628.
198. Markman K.D., Miller A.K. Depression, control, and counterfactual thinking: functional for whom?. J. Soc. Clin. Psychol. 2006, 25(2):210-227.
199. Markman K.D., Weary G. The influence of chronic control concerns on counterfactual thought. Soc. Cogn. 1996, 14(4):292-316.
200. Markou A., Salamone J.D., Bussey T.J., Mar A.C., Brunner D., Gilmour G., Balsam P. Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia. Neurosci. Biobehav. Rev. 2013, 37(9 Pt B):2149-2165.
201. Martinez-Aran A., Vieta E. Cognition as a target in schizophrenia, bipolar disorder and depression. Eur. Neuropsychopharmacol. 2015, pii:S0924-977X(15)00008-5. 10.1016/j.euroneuro.2015.01.007.
202. Mayberg H.S., Lozano A.M., Voon V., McNeely H.E., Seminowicz D., Hamani C., Schwalb J.M., Kennedy S.H. Deep brain stimulation for treatment-resistant depression. Neuron 2005, 45(5):651-660.
203. Mazzucchelli T., Kane R., Rees C. Behavioral Activation treatments for depression in adults: a meta-analysis and review. Clin. Psychol. Sci. Pract. 2009, 16(4):383-411.
204. McDannald M.A., Jones J.L., Takahashi Y.K., Schoenbaum G. Learning theory: a driving force in understanding orbitofrontal function. Neurobiol. Learn. Mem. 2014, 108:22-27.
205. McDermott L.M., Ebmeier K.P. A meta-analysis of depression severity and cognitive function. J. Affect. Disord. 2009, 119(1-3):1-8.
206. McEwen B.S., Gianaros P.J. Central role of the brain in stress and adaptation: links to socioeconomic status, health, and disease. Ann. N. Y. Acad. Sci. 2010, 1186:190-222.
207. McEwen B.S., Morrison J.H. The brain on stress: vulnerability and plasticity of the prefrontal cortex over the life course. Neuron 2013, 79(1):16-29.
208. McIntyre R.S., Filteau M.J., Martin L., Patry S., Carvalho A., Cha D.S., Barakat M., Miguelez M. Treatment-resistant depression: definitions, review of the evidence, and algorithmic approach. J. Affect. Disord. 2014, 156:1-7.
209. McKenzie S., Frank A.J., Kinsky N.R., Porter B., Rivière P.D., Eichenbaum H. Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas. Neuron 2014, 83(1):202-215.
210. McNeely H.E., Mayberg H.S., Lozano A.M., Kennedy S.H. Neuropsychological impact of Cg25 deep brain stimulation for treatment-resistant depression: preliminary results over 12 months. J. Nerv. Ment. Dis. 2008, 196(5):405-410.
211. Meiser J., Weindl D., Hiller K. Complexity of dopamine metabolism. Cell Commun. Signal. 2013, 11(1):34.
212. Meyer J.H., Ginovart N., Boovariwala A., Sagrati S., Hussey D., Garcia A., Young T., Praschak-Rieder N., Wilson A.A., Houle S. Elevated monoamine oxidase a levels in the brain: an explanation for the monoamine imbalance of major depression. Arch. Gen. Psychiatry 2006, 63(11):1209-1216.
213. Michelsen K.A., Schmitz C., Steinbusch H.W. The dorsal raphe nucleus - from silver stainings to a role in depression. Brain Res. Rev. 2007, 55(2):329-342.
214. Mizoguchi K., Yuzurihara M., Ishige A., Sasaki H., Chui D.H., Tabira T. Chronic stress induces impairment of spatial working memory because of prefrontal dopaminergic dysfunction. J. Neurosci. 2000, 20(4):1568-1574.
215. Montague P.R., Dolan R.J., Friston K.J., Dayan P. Computational psychiatry. Trends Cogn. Sci. 2012, 16(1):72-80.
216. Moraga-Amaro R., Gonzalez H., Pacheco R., Stehberg J. Dopamine receptor D3 deficiency results in chronic depression and anxiety. Behav. Brain Res. 2014, 274:186-193.
217. Morgan J.K., Olino T.M., McMakin D.L., Ryan N.D., Forbes E.E. Neural response to reward as a predictor of increases in depressive symptoms in adolescence. Neurobiol. Dis. 2013, 52:66-74.
218. Mueller E.M., Pechtel P., Cohen A.L., Douglas S.R., Pizzagalli D.A. Potentiated processing of negative feedback in depression is attenuated by anhedonia. Depress. Anxiety 2015, 10.1002/da.22338.
219. Must A., Horvath S., Nemeth V.L., Janka Z. The Iowa gambling task in depression - what have we learned about sub-optimal decision-making strategies?. Front. Psychol. 2013, 4:732.
220. Nakahara H. Multiplexing signals in reinforcement learning with internal models and dopamine. Curr. Opin. Neurobiol. 2014, 25:123-129.
221. Naranjo C.A., Tremblay L.K., Busto U.E. The role of the brain reward system in depression. Prog. Neuropsychopharmacol. Biol. Psychiatry 2001, 25(4):781-823.
222. Nassar M.R., Rumsey K.M., Wilson R.C., Parikh K., Heasly B., Gold J.I. Rational regulation of learning dynamics by pupil-linked arousal systems. Nat. Neurosci. 2012, 15(7):1040-1046.
223. Neimat J.S., Hamani C., Giacobbe P., Merskey H., Kennedy S.H., Mayberg H.S., Lozano A.M. Neural stimulation successfully treats depression in patients with prior ablative cingulotomy. Am. J. Psychiatry 2008, 165(6):687-693.
224. Nestler E.J., Carlezon W.A. The mesolimbic dopamine reward circuit in depression. Biol. Psychiatry 2006, 59(12):1151-1159.
225. Nestler E.J., Hyman S.E. Animal models of neuropsychiatric disorders. Nat. Neurosci. 2010, 13(10):1161-1169.
226. Nieuwenhuis S., Holroyd C.B., Mol N., Coles M.G. Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci. Biobehav. Rev. 2004, 28(4):441-448.
227. Niv Y. Reinforcement learning in the brain. J. Math. Psychol. 2009, 53(3):139-154.
228. Niv Y., Schoenbaum G. Dialogues on prediction errors. Trends Cogn. Sci. 2008, 12(7):265-272.
229. Novick A.M., Forster G.L., Tejani-Butt S.M., Watt M.J. Adolescent social defeat alters markers of adult dopaminergic function. Brain Res. Bull. 2011, 86(1-2):123-128.
230. O'Doherty J.P. Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann. N. Y. Acad. Sci. 2011, 1239:118-129.
231. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. N. Y. Acad. Sci. 2007, 1104:35-53.
232. Olvet D.M., Hajcak G. The error-related negativity (ERN) and psychopathology: toward an endophenotype. Clin. Psychol. Rev. 2008, 28(8):1343-1354.
233. Onaivi E.S., Ishiguro H., Gong J.P., Patel S., Meozzi P.A., Myers L., Perchuk A., Mora Z., Tagliaferro P.A., Gardner E., Brusco A., Akinshola B.E., Liu Q.R., Chirwa S.S., Hope B., Lujilde J., Inada T., Iwasaki S., Macharia D., Teasenfitz L., Arinami T., Uhl G.R. Functional expression of brain neuronal CB2 cannabinoid receptors are involved in the effects of drugs of abuse and in depression. Ann. N. Y. Acad. Sci. 2008, 1139:434-449.
234. Opmeer E.M., Kortekaas R., Aleman A. Depression and the role of genes involved in dopamine metabolism and signalling. Prog. Neurobiol. 2010, 92(2):112-133.
235. Otto A.R., Raio C.M., Chiang A., Phelps E.A., Daw N.D. Working-memory capacity protects model-based learning from stress. Proc. Natl. Acad. Sci. U.S.A. 2013, 110(52):20941-20946.
236. Papassotiropoulos A., de Quervaine D.J.F. Failed drug discovery in psychiatry: time for human genome-guided solutions. Trends Cogn. Sci. 2015, (Published online: February 26, 2015). 10.1016/j.tics.2015.02.002.
237. Papp M., Klimek V., Willner P. Effects of imipramine on serotonergic and beta-adrenergic receptor binding in a realistic animal model of depression. Psychopharmacology (Berlin) 1994, 114:309-314.
238. Parker G., Roy K., Mitchell P., Wilhelm K., Malhi G., Hadzi-Pavlovic D. Atypical depression: a reappraisal. Am. J. Psychiatry 2002, 159(9):1470-1479.
239. Paulus M.P., Yu A.J. Emotion and decision-making: affect-driven belief systems in anxiety and depression. Trends Cogn. Sci. 2012, 16(9):476-483.
240. Payzan-LeNestour E., Dunne S., Bossaerts P., O'Doherty J.P. The neural representation of unexpected uncertainty during value-based decision making. Neuron 2013, 79(1):191-201.
241. Pearson-Fuhrhop K.M., Dunn E.C., Mortero S., Devan W.J., Falcone G.J., et al. Dopamine genetic risk score predicts depressive symptoms in healthy adults and adults with depression. PLOS ONE 2014, 9(5):e93772.
242. Perreault M.L., Hasbi A., O'Dowd B.F., George S.R. Heteromeric dopamine receptor signaling complexes: emerging neurobiology and disease relevance. Neuropsychopharmacology 2014, 39(1):156-168.
243. Pizzagalli D.A. Depression, stress, and anhedonia: toward a synthesis and integrated model. Annu. Rev. Clin. Psychol. 2014, 10:393-423.
244. Pizzagalli D.A., Holmes A.J., Dillon D.G., Goetz E.L., Birk J.L., Bogdan R., Dougherty D.D., Iosifescu D.V., Rauch S.L., Fava M. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am. J. Psychiatry 2009, 166(6):702-710.
245. Polter A.M., Kauer J.A. Stress and VTA synapses: implications for addiction and depression. Eur. J. Neurosci. 2014, 39(7):1179-1188.
246. Preuschoff K., 't Hart B.M., Einhauser W. Pupil dilation signals surprise: evidence for noradrenaline's role in decision making. Front. Neurosci. 2011, 5:115.
247. Price J.L., Drevets W.C. Neurocircuitry of mood disorders. Neuropsychopharmacology 2010, 35(1):192-216.
248. Proudfit G.H. The reward positivity from basic research on reward to a biomarker for depression. Psychophysiology 2014, 10.1111/psyp.12370.
249. Proulx C.D., Hikosaka O., Malinow R. Reward processing by the lateral habenula in normal and depressive behaviors. Nat. Neurosci. 2014, 17(9):1146-1152.
250. Puigdemont D., Pérez-Egea R., Portella M.J., Molet J., de Diego-Adeliño J., Gironell A., Radua J., Gómez-Anson B., Rodríguez R., Serra M., de Quintana C., Artigas F., Álvarez E., Pérez V. Deep brain stimulation of the subcallosal cingulate gyrus: further evidence in treatment-resistant major depression. Int. J. Neuropsychopharmacol. 2012, 15(1):121-133.
251. Quelhas A.C., Power M.J., Juhos C., Senos J. Counterfactual thinking and functional differences in depression. Clin. Psychol. Psychother. 2008, 15(5):352-365.
252. Quitkin F.M., McGarth P.J., Stewart J.W., Klein D.F. A reappraisal of atypical depression. Am. J. Psychiatry 2003, 160:798-800.
253. Rachlin H., Raineri A., Cross D. Subjective probability and delay. J. Exp. Anal. Behav. 1991, 55(2):233-244.
254. Radenbach C., Reiter A.M., Engert V., Sjoerds Z., Villringer A., Heinze H.J., Deserno L., Schlagenhauf F. The interaction of acute and chronic stress impairs model-based behavioral control. Psychoneuroendocrinology 2015, 53:268-280. (Epub 2015 Jan 7). 10.1016/j.psyneuen.2014.12.017.
255. Ragland J.D., Cools R., Frank M., Pizzagalli D.A., Preston A., Ranganath C., Wagner A.D. CNTRICS final task selection: long-term memory. Schizophr. Bull. 2009, 35(1):197-212.
256. Rangel A., Clithero J.A. The computation of stimulus values in simple choice. Neuroeconomics: Decision Making and the Brain 2013, 125-147. Elsevier, San Diego. 2nd ed. P. Glimcher, E. Fehr (Eds.).
257. Rasetti R., Weinberger D.R. Intermediate phenotypes in psychiatric disorders. Curr. Opin. Genet. Dev. 2011, 21(3):340-348.
258. Rea E., Rummel J., Schmidt T.T., Hadar R., Heinz A., Mathé A.A., Winter C. Anti-anhedonic effect of deep brain stimulation of the prefrontal cortex and the dopaminergic reward system in a genetic rat model of depression: an intracranial self-stimulation paradigm study. Brain Stimul. 2014, 7(1):21-28.
259. Rice M.E., Patel J.C., Cragg S.J. Dopamine release in the basal ganglia. Neuroscience 2011, 198:112-137.
260. Richard J.M., Castro D.C., Difeliceantonio A.G., Robinson M.J., Berridge K.C. Mapping brain circuits of reward and motivation: in the footsteps of Ann Kelley. Neurosci. Biobehav. Rev. 2013, 37(9 Pt A):1919-1931.
261. Richard-Devantoy S., Berlim M.T., Jollant F. A meta-analysis of neuropsychological markers of vulnerability to suicidal behavior in mood disorders. Psychol. Med. 2014, 44(8):1663-1673.
262. Riesel A., Weinberg A., Endrass T., Kathmann N., Hajcak G. Punishment has a lasting impact on error-related brain activity. Psychophysiology 2012, 49(2):239-247.
263. Riva-Posse P., Choi K.S., Holtzheimer P.E., McIntyre C.C., Gross R.E., Chaturvedi A., Crowell A.L., Garlow S.J., Rajendra J.K., Mayberg H.S. Defining critical white matter pathways mediating successful subcallosal cingulate deep brain stimulation for treatment-resistant depression. Biol. Psychiatry 2014, 76(12):963-969.
264. Rive M.M., van Rooijen G., Veltman D.J., Phillips M.L., Schene A.H., Ruhé H.G. Neural correlates of dysfunctional emotion regulation in major depressive disorder. A systematic review of neuroimaging studies. Neurosci. Biobehav. Rev. 2013, 37(10 Pt 2):2529-2553.
265. Robbins T.W., Arnsten A.F. The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. Annu. Rev. Neurosci. 2009, 32:267-287.
266. Robinson O.J., Overstreet C., Charney D.R., Vytal K., Grillon C. Stress increases aversive prediction error signal in the ventral striatum. Proc. Natl. Acad. Sci. U.S.A. 2013, 110(10):4129-4133.
267. Roeper J. Dissecting the diversity of midbrain dopamine neurons. Trends Neurosci. 2013, 36(6):336-342.
268. Rogóz˙ Z. Combined treatment with atypical antipsychotics and antidepressants in treatment-resistant depression: preclinical and clinical efficacy. Pharmacol. Rep. 2013, 65(6):1535-1544.
269. Roiser J.P., Elliott R., Sahakian B.J. Cognitive mechanisms of treatment in depression. Neuropsychopharmacology 2012, 37(1):117-136.
270. Roy M., Shohamy D., Daw N., Jepma M., Wimmer G.E., Wager T.D. Representation of aversive prediction errors in the human periaqueductal gray. Nat. Neurosci. 2014, 17(11):1607-1612.
271. Russo S.J., Nestler E.J. The brain reward circuitry in mood disorders. Nat. Rev. Neurosci. 2013, 14(9):609-625.
272. Sacher J., Rekkas P.V., Wilson A.A., Houle S., Romano L., Hamidi J., Rusjan P., Fan I., Stewart D.E., Meyer J.H. Relationship of monoamine oxidase-a distribution volume to postpartum depression and postpartum crying. Neuropsychopharmacology 2015, 40(2):429-435.
273. Santiago R.M., Barbiero J., Gradowski R.W., Bochen S., Lima M.M., Da Cunha C., Andreatini R., Vital M.A. Induction of depressive-like behavior by intranigral 6-OHDA is directly correlated with deficits in striatal dopamine and hippocampal serotonin. Behav. Brain Res. 2014, 259:70-77.
274. Savica R., Benarroch E.E. Dopamine receptor signaling in the forebrain: recent insights and clinical implications. Neurology 2014, 83(8):758-767.
275. Schiller D., Levy I., Niv Y., LeDoux J.E., Phelps E.A. From fear to safety and back: reversal of fear in the human brain. J. Neurosci. 2008, 28(45):11517-11525.
276. Schilström B., Konradsson-Geuken A., Ivanov V., Gertow J., Feltmann K., Marcus M.M., Jardemark K., Svensson T.H. Effects of S-citalopram, citalopram, and R-citalopram on the firing patterns of dopamine neurons in the ventral tegmental area, N-methyl-d-aspartate receptor-mediated transmission in the medial prefrontal cortex and cognitive function in the rat. Synapse 2011, 65(5):357-367.
277. Schlaepfer T.E., Cohen M.X., Frick C., Kosel M., Brodesser D., Axmacher N., Joe A.Y., Kreft M., Lenartz D., Sturm V. Deep brain stimulation to reward circuitry alleviates anhedonia in refractory major depression. Neuropsychopharmacology 2008, 33(2):368-377.
278. Schmuckermair C., Gaburro S., Sah A., Landgraf R., Sartori S.B., Singewald N. Behavioral and neurobiological effects of deep brain stimulation in a mouse model of high anxiety- and depression-like behavior. Neuropsychopharmacology 2013, 38(7):1234-1244.
279. Schott B.H., Frischknecht R., Debska-Vielhaber G., John N., Behnisch G., Düzel E., Gundelfinger E.D., Seidenbecher C.I. Membrane-bound catechol-O-methyl transferase in cortical neurons and glial cells is intracellularly oriented. Front. Psychiatry 2010, 1:142. 10.3389/fpsyt.2010.00142.
280. Schuldiner S., Shirvan A., Linial M. Vesicular neurotransmitter transporters: from bacteria to humans. Physiol. Rev. 1995, 75(2):369-392.
281. Schultz W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 2006, 57:87-115.
282. Schultz W. Dopamine signals for reward value and risk: basic and recent data. Behav. Brain Funct. 2010, 6:24.
283. Schwabe L., Wolf O.T. Stress-induced modulation of instrumental behavior: from goal-directed to habitual control of action. Behav. Brain Res. 2011, 219(2):321-328.
284. Schwabe L. Stress and the engagement of multiple memory systems: integration of animal and human studies. Hippocampus 2013, 23(11):1035-1043.
285. Schwartz K., Yadid G., Weizman A., Rehavi M. Decreased limbic vesicular monoamine transporter 2 in a genetic rat model of depression. Brain Res. 2003, 965(1-2):174-179.
286. Seo H., Cai X., Donahue C.H., Lee D. Neural correlates of strategic reasoning during competitive games. Science 2014, 346(6207):340-343.
287. Sesack S.R., Grace A.A. Cortico-basal ganglia reward network: microcircuitry. Neuropsychopharmacology 2010, 35(1):27-47.
288. Sesack S.R., Hawrylak V.A., Guido M.A., Levey A.I. Cellular and subcellular localization of the dopamine transporter in rat cortex. Adv. Pharmacol. 1998, 42:171-174.
289. Sharot T., Guitart-Masip M., Korn C.W., Chowdhury R., Dolan R.J. How dopamine enhances an optimism bias in humans. Curr. Biol. 2012, 22(16):1477-1481.
290. Sharot T., Shiner T., Brown A.C., Fan J., Dolan R.J. Dopamine enhances expectation of pleasure in humans. Curr. Biol. 2009, 19(24):2077-2080.
291. Sharp C., Monterosso J., Montague P.R. Neuroeconomics: a bridge for translational research. Biol. Psychiatry 2012, 72(2):87-92.
292. Sherdell L., Waugh C.E., Gotlib I.H. Anticipatory pleasure predicts motivation for reward in major depression. J. Abnorm. Psychol. 2012, 121(1):51-60.
293. Shiffrin R.M., Schneider W. Controlled and automatic human information processing. II: Perceptual learning, automatic attending, and a general theory. Psychol. Rev. 1977, 84:127-190.
294. Shimp C.P. Short-term memory in the pigeon: the previously reinforced response. J. Exp. Anal. Behav. 1976, 26(3):487-493.
295. Sinclair D., Purves-Tyson T.D., Allen K.M., Weickert C.S. Impacts of stress and sex hormones on dopamine neurotransmission in the adolescent brain. Psychopharmacology (Berlin) 2014, 231(8):1581-1599.
296. Smittenaar P., Fitz Gerald T.H., Romei V., Wright N.D., Dolan R.J. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron 2013, 80(4):914-919.
297. Snyder H.R. Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: a meta-analysis and review. Psychol. Bull. 2013, 139(1):81-132.
298. Solé B., Jiménez E., Martinez-Aran A., Vieta E. Cognition as a target in major depression: new developments. Eur. Neuropsychopharmacol. 2015, pii:S0924-977X(14)00351-4. 10.1016/j.euroneuro.2014.12.004.
299. Spasojevic N., Stanisavljevic D., Gavrilovic L., Jovanovic P., Cucakovic A., Dronjak S. Hippocampal asymmetry in expression of catecholamine synthesizing enzyme and transporters in socially isolated rats. Neuroendocrinol. Lett. 2012, 33(6):631-635.
300. Squire L.R., Zola S.M. Structure and function of declarative and nondeclarative memory systems. Proc. Natl. Acad. Sci. U.S.A. 1996, 93:13515-13522.
301. Starcke K., Brand M. Decision making under stress: a selective review. Neurosci. Biobehav. Rev. 2012, 36(4):1228-1248.
302. Steele J.D., Kumar P., Ebmeier K.P. Blunted response to feedback information in depressive illness. Brain 2007, 130(Pt 9):2367-2374.
303. Stephan K.E., Mathys C. Computational approaches to psychiatry. Curr. Opin. Neurobiol. 2014, 25:85-92.
304. Stewart J.W. Treating depression with atypical features. J. Clin. Psychiatry 2007, 68(Suppl. 3):25-29.
305. Stewart J.W., McGrath P.J., Quitkin F.M., Klein D.F. DSM-IV depression with atypical features: is it valid?. Neuropsychopharmacology 2009, 34(13):2625-2632.
306. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press, Cambridge, MA.
307. Takahashi T. Cortisol levels and time-discounting of monetary gain in humans. Neuroreport 2004, 15(13):2145-2147.
308. Takahashi T. Theoretical frameworks for neuroeconomics of intertemporal choice. J. Neurosci. Psychol. Econ. 2009, 2:75-90.
309. Takahashi T. A neuroeconomic theory of rational addiction and nonlinear time-perception. Neuroendocrinol. Lett. 2011, 32(3):221-225.
310. Takahashi T. Neuroeconomics of suicide. Neuroendocrinol. Lett. 2011, 32(4):400-404.
311. Takahashi T., Han R., Nishinaka H., Makino T., Fukui H. The q-exponential probability discounting of gain and loss. Appl. Math. 2013, 4:876-881. 10.4236/am.2013.46120.
312. Takahashi T., Ikeda K., Fukushima H., Hasegawa T. Salivary alpha-amylase levels and hyperbolic discounting in male humans. Neuroendocrinol. Lett. 2007, 28(1):17-20.
313. Takahashi T., Ikeda K., Hasegawa T. Salivary alpha-amylase levels and temporal discounting for primary reward under a simulated life-threatening condition. Neuroendocrinol. Lett. 2008, 29(4):451-453.
314. Takahashi T., Oono H., Inoue T., Boku S., Kako Y., Kitaichi Y., Kusumi I., Masui T., Nakagawa S., Suzuki K., Tanaka T., Koyama T., Radford M.H. Depressive patients are more impulsive and inconsistent in intertemporal choice behavior for monetary gain and loss than healthy subjects - an analysis based on Tsallis' statistics. Neuroendocrinol. Lett. 2008, 29(3):351-358.
315. Takahashi T., Shinada M., Inukai K., Tanida S., Takahashi C., Mifune N., Takagishi H., Horita Y., Hashimoto H., Yokota K., Kameda T., Yamagishi T. Stress hormones predict hyperbolic time-discount rates six months later in adults. Neuroendocrinol. Lett. 2010, 31(5):616-621.
316. Thase M.E. Atypical depression: useful concept, but it's time to revise the DSM-IV criteria. Neuropsychopharmacology 2009, 34(13):2633-2641.
317. Treadway M.T., Bossaller N.A., Shelton R.C., Zald D.H. Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. J. Abnorm. Psychol. 2012, 121(3):553-558.
318. Treadway M.T., Buckholtz J.W., Cowan R.L., Woodward N.D., Li R., Ansari M.S., Baldwin R.M., Schwartzman A.N., Kessler R.M., Zald D.H. Dopaminergic mechanisms of individual differences in human effort-based decision-making. J. Neurosci. 2012, 32(18):6170-6176.
319. Treadway M.T., Buckholtz J.W., Schwartzman A.N., Lambert W.E., Zald D.H. Worth the 'EEfRT'? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. PLoS ONE 2009, 4(8):e6598be.
320. Treadway M.T., Zald D.H. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev. 2011, 35(3):537-555.
321. Treadway M.T., Zald D.H. Parsing anhedonia: translational models of reward-processing deficits in psychopathology. Curr. Dir. Psychol. Sci. 2013, 22(3):244-249.
322. Trew J.L. Exploring the roles of approach and avoidance in depression: an integrative model. Clin. Psychol. Rev. 2011, 31(7):1156-1168.
323. Tritsch N.X., Sabatini B.L. Dopaminergic modulation of synaptic transmission in cortex and striatum. Neuron 2012, 76(1):33-50.
324. Turner P., Kantaria R., Young A.H. A systematic review and meta-analysis of the evidence base for add-on treatment for patients with major depressive disorder who have not responded to antidepressant treatment: a European perspective. J. Psychopharmacol. 2014, 28(2):85-98.
325. Tye K.M. Neural circuit reprogramming: a new paradigm for treating neuropsychiatric disease?. Neuron 2014, 83(6):1259-1261.
326. Tye K.M., Mirzabekov J.J., Warden M.R., Ferenczi E.A., Tsai H.C., Finkelstein J., Kim S.Y., Adhikari A., Thompson K.R., Andalman A.S., Gunaydin L.A., Witten I.B., Deisseroth K. Dopamine neurons modulate neural encoding and expression of depression-related behaviour. Nature 2013, 493(7433):537-541.
327. Ullsperger M., Danielmeier C., Jocham G. Neurophysiology of performance monitoring and adaptive behavior. Physiol. Rev. 2014, 94(1):35-79.
328. Vaidyanathan U., Nelson L.D., Patrick C.J. Clarifying domains of internalizing psychopathology using neurophysiology. Psychol. Med. 2012, 42(3):447-459.
329. Valenti O., Gill K.M., Grace A.A. Different stressors produce excitation or inhibition of mesolimbic dopamine neuron activity: response alteration by stress pre-exposure. Eur. J. Neurosci. 2012, 35(8):1312-1321.
330. Valverde O., Torrens M. CB1 receptor-deficient mice as a model for depression. Neuroscience 2012, 204:193-206.
331. van Heeringen K., Bijttebier S., Desmyter S., Vervaet M., Baeken C. Is there a neuroanatomical basis of the vulnerability to suicidal behavior? A coordinate-based meta-analysis of structural and functional MRI studies. Front. Hum. Neurosci. 2014, 8:824. 10.3389/fnhum.2014.00824.
332. Van't Veer A., Carlezon W.A. Role of kappa-opioid receptors in stress and anxiety-related behavior. Psychopharmacology (Berlin) 2013, 229(3):435-452.
333. Veerakumar A., Challis C., Gupta P., Da J., Upadhyay A., Beck S.G., Berton O. Antidepressant-like effects of cortical deep brain stimulation coincide with pro-neuroplastic adaptations of serotonin systems. Biol. Psychiatry 2014, 76(3):203-212.
334. Vinod K.Y., Hungund B.L. Role of the endocannabinoid system in depression and suicide. Trends Pharmacol. Sci. 2006, 27(10):539-545.
335. Vrieze E., Pizzagalli D.A., Demyttenaere K., Hompes T., Sienaert P., de Boer P., Schmidt M., Claes S. Reduced reward learning predicts outcome in major depressive disorder. Biol. Psychiatry 2013, 73(7):639-645.
336. Wahlstrom D., White T., Luciana M. Neurobehavioral evidence for changes in dopamine system activity during adolescence. Neurosci. Biobehav. Rev. 2010, 34(5):631-648.
337. Walsh M.M., Anderson J.R. Learning from experience: event-related potential correlates of reward processing, neural adaptation and behavioral choice. Neurosci. Biobehav. Rev. 2012, 36:1870-1884.
338. Walsh J.J., Han M.H. The heterogeneity of ventral tegmental area neurons: projection functions in a mood-related context. Neuroscience 2014, 282C:101-108.
339. Wardle M.C., Treadway M.T., Mayo L.M., Zald D.H., de Wit H. Amping up effort: effects of d-amphetamine on human effort-based decision-making. J. Neurosci. 2011, 31(46):16597-16602.
340. Watkins E.R., Nolen-Hoeksema S. A habit-goal framework of depressive rumination. J. Abnorm. Psychol. 2014, 123(1):24-34.
341. Wayment H.K., Schenk J.O., Sorg B.A. Characterization of extracellular dopamine clearance in the medial prefrontal cortex: role of monoamine uptake and monoamine oxidase inhibition. J. Neurosci. 2001, 21(1):35-44.
342. Wiecki T.V., Poland J.S., Frank M.J. Model-based cognitive neuroscience approaches to computational psychiatry: clustering and classification. Clin. Psychol. Sci. 2015, (Published online: March 10, 2015). 10.1177/2167702614565359.
343. Williams B.A. Choice as a function of local versus molar reinforcement contingencies. J. Exp. Anal. Behav. 1991, 56(3):455-473.
344. Willner P., Klimek V., Golembiowska K., Muscat R. Changes in mesolimbic dopamine may explain stress-induced anhedonia. Psychobiology 1991, 19:79-84.
345. Wilson R.C., Takahashi Y.K., Schoenbaum G., Niv Y. Orbitofrontal cortex as a cognitive map of task space. Neuron 2014, 81(2):267-279.
346. Winter C., von Rumohr A., Mundt A., Petrus D., Klein J., Lee T., Morgenstern R., Kupsch A., Juckel G. Lesions of dopaminergic neurons in the substantia nigra pars compacta and in the ventral tegmental area enhance depressive-like behavior in rats. Behav. Brain Res. 2007, 184(2):133-141.
347. Wright B.M., Eiland E.H., Lorenz R. Augmentation with atypical antipsychotics for depression: a review of evidence-based support from the medical literature. Pharmacotherapy 2013, 33(3):344-359.
348. Wunderlich K., Smittenaar P., Dolan R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 2012, 75(3):418-424.
349. Worbe Y., Savulich G., de Wit S., Fernandez-Egea E., Robbins T.W. Tryptophan depletion promotes habitual over goal-directed control of appetitive responding in humans. Int. J. Neuropsychopharmacol. 2015, pii:pyv013. 10.1093/ijnp/pyv013.
350. Yang Y.K., Yeh T.L., Yao W.J., Lee I.H., Chen P.S., Chiu N.T., Lu R.B. Greater availability of dopamine transporters in patients with major depression - a dual-isotope SPECT study. Psychiatry Res. 2008, 162(3):230-235.
351. Yetnikoff L., Lavezzi H.N., Reichard R.A., Zahm D.S. An update on the connections of the ventral mesencephalic dopaminergic complex. Neuroscience 2014, 282C:23-48.
352. Yu A.J., Dayan P. Uncertainty, neuromodulation, and attention. Neuron 2005, 46:681-692.
353. Zajonc R.B. Feeling and thinking: preferences need no inferences. Am. Psychol. 1982, 35:151-175.
354. Zhang J., Berridge K.C., Tindell A.J., Smith K.S., Aldridge J.W. A neural computational model of incentive salience. PLoS Comput. Biol. 2009, 5:e1000437.
355. Zhang W.N., Chang S.H., Guo L.Y., Zhang K.L., Wang J. The neural correlates of reward-related processing in major depressive disorder: a meta-analysis of functional magnetic resonance imaging studies. J. Affect. Disord. 2013, 151(2):531-539.
356. Zubieta J.K., Ketter T.A., Bueller J.A., Xu Y., Kilbourn M.R., Young E.A., Koeppe R.A. Regulation of human affective responses by anterior cingulate and limbic mu-opioid neurotransmission. Arch. Gen. Psychiatry 2003, 60(11):1145-1153.