Animal models of extinction-induced depression: Loss of reward and its consequences

Neuroscience and Biobehavioral Reviews

Volumn 37, Issue 9, 2013, Pages 2059-2070

  Huston, Joseph P ^a   Silva, Maria A de Souza ^a   Komorowski, Mara ^a   Schulz, Daniela ^b   Topic, Bianca ^a  

^a HEINRICH HEINE UNIVERSITY   (Germany)

^b Stony Brook University   (United States)

Author keywords

Aggression; Animal model of depression; Antidepressants; Avoidance; Biting; Immobility; Operant conditioning; Rearing behavior; Water maze; Withdrawal

Indexed keywords

ANTIDEPRESSANT AGENT; CITALOPRAM; CLOMIPRAMINE; IMIPRAMINE;

AGGRESSION; ANIMAL BEHAVIOR; ANIMAL MODEL; BITING BEHAVIOR; DEPRESSION; DRUG RESPONSE; ESCAPE BEHAVIOR; EXTINCTION INDUCED DEPRESSION; HUMAN; IMMOBILITY; NONHUMAN; PRIORITY JOURNAL; PSYCHOSOCIAL WITHDRAWAL; REARING; REINFORCEMENT; REVIEW; REWARD;

AGGRESSION; ANIMAL MODEL OF DEPRESSION; ANTIDEPRESSANTS; AVOIDANCE; BITING; IMMOBILITY; OPERANT CONDITIONING; REARING BEHAVIOR; WATER MAZE; WITHDRAWAL;

ANIMALS; ANTIDEPRESSIVE AGENTS; BEHAVIOR, ANIMAL; DEPRESSION; DISEASE MODELS, ANIMAL; EXTINCTION, PSYCHOLOGICAL; HUMANS; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84887991385     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2013.02.016     Document Type: Review

References (117)

1. Almeida O.P., Burton E.J.M., Ferrier N., McKeith I.G., O'Brien I.T. Depression with late onset is associated with right frontal lobe atrophy. Psychological Medicine 2003, 33:675-681.
2. American Psychiatric Association, 2000. Diagnostic and Statistical Manual of Mental Disorders. DSM-IV-TR 4th edition. Washington, USA.
3. Amsel A. The role of frustrative nonreward in noncontinuous reward situations. Psychological Bulletin 1958, 55:102-119.
4. Amsel A., Radek C.C., Graham M., Letz R. Ultrasound emission in infant rats as an indicant of arousal during appetitive learning and extinction. Science 1977, 197:786-788.
5. Andrzejewski M.E., Schochet T.L., Feit E.C., Harris R., McKee B.L., Kelley A.E. A comparison of adult and adolescent rat behavior in operant learning, extinction, and behavioral inhibition paradigms. Behavioral Neuroscience 2011, 125:93-105.
6. Anisman H., Matheson K. Stress, depression, and anhedonia: caveats concerning animal models. Neuroscience and Biobehavioral Reviews 2005, 29:525-546.
7. Apostolakis E.M., Ramamurphy M., Zhou D., Onate S., O'Malley B.W. Acute disruption of selected steroid receptor coactivators prevents reproductive behaviour in rats and unmasks genetic adaptation in knockout mice. Molecular Endocrinology 2002, 16:1511-1523.
8. Armone M., Dantzer R. Effects of diazepam on extinction induced aggression in pigs. Pharmacology Biochemistry and Behavior 1980, 13:27-30.
9. Azrin N.H., Hutchinson R.R., Hake D.F. Extinction-induced aggression. Journal of Experimental Analysis of Behavior 1966, 9:191-204.
10. Baldwin D.S., Lopes A.T.V. The influence of comorbid anxiety disorders on outcome in major depressive disorder. Medicographia 2009, 31:126-131.
11. Barr A.M., Markou A. Psychostimulant withdrawal as an inducing condition in animal models of depression. Neuroscience and Biobehavioral Reviews 2005, 29:675-706.
12. Beck C.H.M., Loh E.A. Reduced behavioral variability in extinction: effects of chronic treatment with benzodiazepine, diazepam or with ethanol. Psychopharmacology 1990, 100:323-327.
13. Bentosela M., Barrera G., Jacovcevic A., Elgier A.M., Mustaca A.E. Effect of reinforcement, reinforcer omission and extinction on a communicative response in domestic dogs (Canis familiaris). Behavioral Processes 2008, 78:464-469.
14. Belzung C., Lemoine M. Criteria of validity for animal models of psychiatric disorders: focus on anxiety disorders and depression. Biology of Mood and Anxiety Disorders 2011, 1:9. doi:10.1186/2045-5380-1-9.
15. Berton O., Hahn C.-G., Thase M.E. Are we getting closer to valid translational models for major depression?. Science 2012, 338:75-79.
16. Bowlby J. Maternal care and mental health 1951, World Health Organization Monograph.
17. Bowlby J. Developmental psychiatry comes of age. American Journal of Psychiatry 1988, 145:1-10.
18. Brandao M.L., Vianna D.V.M., Troncoso A.C., de Souza Silva M.A., Huston J.P. The relevance of neuronal substrates of defense to anxiety and stress: empirical and conceptual considerations. European Journal of Pharmacology 2003, 463:225-233.
19. Burokas A., Gutiérrez-Cuesta J., Martin-Garcia E., Maldonado R. Operant model of frustrated expected reward in mice. Addiction Biology 2012, 17:770-782.
20. Brown G.W., Andrews B., Harris T., Adler Z., Bridge L. Social support, self-esteem and depression. Psychological Medicine 1986, 16:813-831.
21. Bruce M.L. Psychosocial risk factors for depressive disorders in late life. Biological Psychiatry 2002, 52:175-184.
22. Cairney J., Krause N. Negative life events and age-related decline I mastery: are older adults more vulnerable to the control-eroding effects of stress?. Journal of Gerontology: Social Sciences 2008, 63:162-170.
23. Carvalho J.P., Hopko D.R. Behavioral theory of depression: Reinforcement as a mediating variable between avoidance and depression. Journal of Behavior Therapy and Experimental Psychiatry 2011, 42:154-162.
24. Carvalho J.P., Trent L.R., Hopko D.R. The impact of decreased environmental reard in predicting depression severity: support for behavioral theories of depression. Psychpathology 2011, 44:242-252.
25. Coe L.C., Stanton M.E., Levine S. Adrenal responses to reinforcement and extinction: role of expectancy versus instrumental responding. Behavioral Neuroscience 1983, 97:654-657.
26. Coover G.D., Goldman L., Levine S. Plasma corticosterone increases produced by extinction of operant behavior in rats. Physiology and Behavior 1971, 6:261-263.
27. Cryan J.F., Markou A., Lucki I. Assessing antidepressant activity in rodents; recent developments and future needs. Trends in Pharmacological Sciences 2002, 23:238-245.
28. Cryan J.F., Mombereau C., Vassout A. The tail suspension test as a model for assessing antidepressant activity: review of pharmacological and genetic studies in mice. Neuroscience and Biobehavioral Reviews 2005, 29:571-662.
29. Daly H.B. Reinforcing properties of escape from frustration aroused in various learning situations. Learning and Motivation 1974, 8:187-231.
30. Dantzer R., Armone M., Mormede P. Effects of frustration on behaviour an plasma corticostroide levels in pigs. Physiology and Behavior 1980, 24:1-4.
31. Devenport l.D. Extinction-induced spatial dispersion in the radial arm maze: Arrest by ethanol. Behavioral Neuroscience 1984, 98:979-985.
32. Doob A.N., Kirshenbaum H.M. The effects of arousal of frustration and aggressive films. Journal of Experimental Social Psychology 1973, 9:57-64.
33. Douglas V.I., Parry P.A. Effects of reward and nonreward on frustration and attention in attention deficit disorder. Journal of Abnormal Child Psychology 1994, 22:281-302.
34. Duman C.H. Models of depression. Vitamins and Hormones 2010, 82:1-21.
35. Duman.R.S., Monteggia L.M. A neurotrophic model for stress-related mood disorders. Biological Psychiatry 2006, 59:1116-1127.
36. Edwards, S., Koob, G.F., 2012. Experimental psychiatric illness and drug abuse models: from human to animal, an overview. In: Firas, H., Kobeissy (Eds.), Psychiatric Disorders: Methods and Protocols, Methods in Molecular Biology, vol. 829, pp. 31-48.
37. Eshel N., Roiser J.P. Reward and punishment processing in depression. Biological Psychiatry 2010, 68:118-124.
38. Emley G.S., Hutchinson R.R., Brannan I.B. Aggression: Effect of acute and chronic morphine. Michigan Mental Health Research Bulletin 1970, 4:23-26.
39. Fava M., Uebelacker L.A., Alpert J.E., Nierenberg A.A., Pava J.A., Rosenbaum J.F. Major depressive subtypes and treatment response. Biological Psychiatry 1997, 42:568-576.
40. Fernández-Guasti A., Fiedler J.L., Herrera L., Handa R.J. Sex, stress, and mood disorders: at the intersection of adrenal and gonadal hormones. Hormone and Metabolic Research 2012, 44:607-618.
41. Fernando A.B.P., Robbins T.W. Animal models of neuropsychiatric disorders. Annual Review of Clinical Psychology 2011, 7:39-61.
42. Ferster C.B. A functional analysis of depression. American Psychologist 1973, 28:857-870.
43. Flaherty C.F. Incentive contrast: A review of behavioral changes following shifts in reward. Animal Learning and Behavior 1982, 10:409-440.
44. Flaherty C.F. Effects of anxiolytics and antidepressants on extinction and negative contrast. Pharmacology and Therapeutics 1990, 46:309-320.
45. Flaherty C.F., Troncoso B., Deschu N. Open field behaviors correlated with reward availability and reward shift in three rat strains. American Journal of Psychology 1979, 92:385-400.
46. Fone K.C., Porkess M.V. Behavioural and neurochemical effects of post-weaning social isolation in rodents-relevance to developmental neuropsychiatric disorders. Neuroscience and Biobehavioral Reviews 2008, 32:1087-1102.
47. Gawin F.H., Kleber H.D. Abstinence symptomatology and psychiatric diagnosis in cocaine abusers. Clinical observations. Archives of General Psychiatry 1986, 43:107-113.
48. Geyer M.A., Markou A. The role of preclinical models in the development of psychotropic drugs. Neuropsychopharmacology: The Fifth Generation of Progress 2002, 445-455. Lippincott Williams and Wilkins, Philadelphia. K.L. Davis, D. Charney, J.T. Coyle, C. Nemeroff (Eds.).
49. Gilmer W.S., McKinney W.T. Early experience and depressive disorders: human and non-human primate studies. Journal of Affective Disorders 2003, 75:97-113.
50. Hall F.S. Social deprivation of neonatal, adolescent, and adult rats has distinct neurochemical and behavioral consequences. Critical Reviews in Neurobiology 1998, 12:129-162.
51. Hammen C. Stress and depression. Annual Reviews in Clinical Psychology 2005, 1:293-319.
52. Holahan C.J., Moos R.H., Holahan C.K., Cronkite R.C. Resource loss, resource gain and depressive symptoms. A 10 year model. Journal of Personality and Social Psychology 1999, 77:620-629.
53. Hopko D.R., Lejuez C.W., Ruggiero K.J., Eifert G.H. Contemporary behavioral activation treatments for depression: procedures, principles, and progress. Clinical Psychological Review 2003, 23:699-717.
54. Horesh N., Iancu I. A comparison of life events in patients with unipolar disorder or bipolar disorder and controls. Comprehensive Psychiatry 2010, 51:157-164.
55. Huston J.P., de Souza Silva M.A., Topic B., Müller C.P. What's conditioned in the conditioned place preference?. Trends in Pharmacological Sciences 2013, 34:162-166.
56. Huston J.P., Schulz D., Topic B. Toward an animal model of extinction-induced despair: focus on aging and physiological indices. Journal of Neural Transmission 2009, 116:1029-1036.
57. Huston J.P., van den Brink J., Komorowski M., Huq Y., Topic B. Antidepressants reduce extinction-induced withdrawal behaviours: a model for depressive-like behaviour. Neuroscience 2012, 210:249-257.
58. Kawasaki K., Iwasaki T. Corticosterone levels during extinction of runway response in rats. Life Science 1997, 61:1721-1728.
59. Keller M.C., Nesse R.M. Is low mood an adaptation? Evidence for subtypes with symptoms that match precipitants. Journal of Affective Disorders 2005, 86:27-35.
60. Kelly J.F., Hake D.F. An extinction-induced increase in an aggressive response with humans. Journal of Experimental Analysis of Behavior 1970, 14:153-164.
61. Kessler R.C. The effects of stressful life events on depression. Annual review of Psychology 1997, 48:191-214.
62. Komorowski M., Huston J.P., Klingenhegel I., Paulat J., Sackers J., Topic B. Distance from source of reward as a marker for extinction-induced despair: modulation by the antidepressants clomipramine and citalopram. Neuroscience 2012, 223:152-162.
63. Kraaij V., Arensman E., Spinhoven P. Negative life events and depression in elderly persons: a meta-analysis. Journal of Gerontology: Psychosocial Sciences 2002, 57(B):87-94.
64. Krishnan V., Nestler E.J. Animal models of depression: molecular perspectives. Current Topics in Behavioral Neurosciences 2011, 7:121-147.
65. Kumar A., Thomas A., Lavretsky H., Huda A., Curran J., Venkatraman T., Estanol L., Mintz J., Toga A. Frontal white matter biochemical abnormalities in later-life major depression detected with proton magnetic resonance spectroscopy. American Journal of Psychiatry 2002, 159:630-636.
66. Lenze E.J. Comorbidity of depression and anxiety in the elderly. Current Psychiatry Reports 2003, 5:62-67.
67. Lerman D.C., Iwata B.A., Wallace M.D. Side effects of extinction: prevalence of bursting and aggression during treatment of self-injurious behavior. Journal of Applied Behavior Analysis 1999, 32:1-8.
68. Leventhal A.M. Sadness, depression, and avoidance behavior. Behavior Modification 32, 759-779.Lewinsohn, P.M., 1974, A behavioral approach to depression. The Psychology of Depression: Contemporary Theory and Research 2008, 157-178. John Wiley & Son, New York. R.J. Friedman, M.M. Katz (Eds.).
69. Lewis M., Alessandri S.M., Sullivan M.W. Violation of expectancy, loss of control, and anger expressions in young infants. Developmental Psychology 1990, 26:745-751.
70. Lewis M., Hitchcock D.F.A., Sillivan M.W. Physiological and emotional reactivity to learning and frustration. Infancy 2004, 6:121-143.
71. Lewis M., Ramsey D. Infant emotional response and Cortisol response to goal blockage. Child Development 2005, 76:518-530.
72. Looney T.A., Cohen P.S. Aggression induced by intermittent positive reinforcement. Neuroscience and Biobehavioral Reviews 1982, 6:15-37.
73. Lucki I., Frazer A. Performance and extinction of lever press behaviour following chronic administration of desipramine to rats. Psychopharmacology 1985, 85:253-259.
74. Manos R.C., Kanter J.W., Busch A.M. A critical review of assessment strategies to measure the behavioral activation model of depression. Clinical Psychology Review 2010, 30:547-561.
75. Marco E.M., Adriani W., Llorente R., Laviola G., Viveros M.P. Detrimental psychophysiological effects of early maternal deprivation in adolescent and adult rodents: altered responses to cannabinoid exposure. Neuroscience and Biobehavioral Reviews 2009, 33:498-507.
76. Martell C.R., Addis M.E., Jacobson N.S. Depression in context: Strategies for guided action 2001, New York, Norton.
77. Matsumoto K., Pinna G., Puia G., Guidotti A., Costa E. Social isolation stress-induced aggression in mice: a model to study the pharmacology of neurosteroidogenesis. Stress 2005, 8:85-93.
78. Mazure C.M. Life stressors at risk factors in depression. Clinical Psychology: Science and Practice 1998, 5:291-313.
79. Miller N.E., Stevenson S.S. Agitated behaviour of rats during experimental extinction and a curve of spontaneous recovery. Journal of Comparative Psychology 1936, 21:205-231.
80. Morris R. Developments of a water-maze procedure for studying spatial learning in the rat. Journal of Neuroscience Methods 1984, 11:47-60.
81. Nestler E.J., Gould E., Manji H., Buncan M., Duman R.S., Greshenfeld H.K., Hen R., Koester S., Lederhendler I., Meaney M., Robbins T., Winsky L., Zalcman S. Preclinical models: status of basic research in depression. Biological Psychiatry 2002, 52:503-528.
82. Nestler E.J., Hyman S.E. Animal models of neuropsychiatric disorders. Nature Neuroscience 2010, 13:1161-1169.
83. Newport D.J., Stowe Z.N., Nemeroff C.B. Parental depression: animal models of an adverse life event. American Journal of Psychiatry 2002, 159:1265-1283.
84. Nikiforuk A., Popik P. Antidepressants alleviate the impact of reinforcer downshift. European Neuropsychopharmacology 2009, 19:41-48.
85. Norris J.N., Perez-Acosta A.M., Ortega L.A., Papini M.R. Naloxone facilitates appetitive extinction and eliminates escape from frustration. Pharmacology Biochemistry and Behavior 2009, 94:81-87.
86. Painuly N., Sharan P., Mattoo S.K. Relationship of anger and anger attacks with depression. European Archive of Psychiatry and Clinical Neuroscience 2005, 255:215-222.
87. Otis J., Ley R. The effects of frustration induced by discontinuation of reinforcement on force of response and magnitude of the skin conductance response. Bulletin of the Psychonomic Society 1993, 31:97-100.
88. Ott V., Friedrich M., Prilop S., Lehnert H., Jauch-Chara K., Born J., Hallschmid M. Food anticipation and subsequent withdrawal increase serum cortisol in healthy men. Physiology and Behavior 2011, 103:594-599.
89. Ottenbreit N.D., Dobson K.S. Avoidance and depression: the construction of the cognitive-behavioral avoidance scale. Behavior Research and Therapy 2004, 42:293-313.
90. Papini M.R. Comparative psychology of surprising nonreward. Brain Behavior and Evolution 2003, 62:83-95.
91. Papini M.R., Dudley R.T. Consequences of surprising reward omissions. Review of General Psychology 1997, 1:175-197.
92. Pollak D.D., Rey C.E., Moje F.J. Rodent models in depression research: classical strategies and new directions. Annals of Medicine 2010, 42:252-264.
93. Porsolt R.D., LePichon M., Jalfre M. Depression: A new animal model sensitive to antidepressant treatments. Nature 1977, 266:730-732.
94. Post R.M. Kindling and sensitization as models for affective episode recurrence, cyclicity, and tolerance phenomena. Neuroscience & Biobehavioral Reviews 2007, 31:858-873.
95. Prados J., Sansa J., Artigas A.A. Partial reinforcement effects on learning and extinction of place preferences in the water maze. Learning and Behavior 2008, 36:311-318.
96. Prut L., Belzung C. The open field as a paradigm to measure the effects of drugs on anxiety-like behavior: a review. European Journal of Pharmacology 2003, 463:3-33.
97. Schulz D., Topic B., de Sousa Silva M.A., Huston J.P. Extinction induced immobility in the water maze and its neurochemical concomitants in aged and adult rats: a possible model for depression?. Neurobiology of Learning and Memory 2004, 82:128-141.
98. Schulz D., Buddenberg T., Huston J.P. Extinction-induced "despair" in the water maze, exploratory behavior and fear: effects of chronic antidepressant treatment. Neurobiology of Learning and Memory 2007, 87:624-634.
99. Schulz D., Huston J.P., Buddenberg T., Topic B. "Despair" induced by extinction trials in the water maze: relationship with measures of anxiety in aged and adult rats. Neurobiology of Learning and Memory 2007, 87:309-323.
100. Seligman M.E. Learned helplessness. Annual Review of Medicine 1972, 23:407-412.
101. Skinner B.F. Behavior of Organisms 1938, Appleton-Century-Crofts, New York.
102. Skinner B.F. Science and Human Behavior 1953, Macmillan, New York.
103. Spitz R.A. Hospitalism - an inquiry into the genesis of psychiatric conditions in early childhood. Psychoanalytic Study of the Child 1945, 1:53-74.
104. Spitz R.A. The psychogenic disease in infancy-an attempt at their etiologic classification. Psychoanalytic Study of the Child 1951, 6:255-275.
105. Taylor W.D., Steffebsm D.C., Payne M.E., MacFall J.R., Marchuk D.A., Svenson I.K., Krishnan K.R.R. Influence of serotonin transporter promoter region polymorphisms on hippocampal volumes in late-life depression. Archives of General Psychiatry 2005, 62:537-544.
106. Thompson T., Bloom W. Aggressive behavior and extinction-induced response rate increase. Psychonomic Science 1966, 5:335-336.
107. Topic B., Dere E., Schulz D., de Souza Silva M.A., Jocham G., Kart E., Huston J.P. Aged and adult rats compared in acquisition and extinction of escape from the water maze: focus on individual differences. Behavioral Neuroscience 2005, 119:127-144.
108. Topic B., Huston J.P., Namestkova K., Zhu S.W., Mohammed A.H., Schulz D. Extinction-induced "despair" in aged and adult rats: links to neurotrophins in frontal cortex and hippocampus. Neurobiology of Learning and Memory 2008, 90:519-526.
109. Topic B., Kröger I., Vildirasova P.G., Huston J.P. Indices of extinction-induced "depression" after operant learning using a runway vs. a cued free-reward delivery schedule. Neurobiology of Learning and Memory 2012, 98:329-340.
110. Topic B., Oitzl M.S., Meijer O.C., Huston J.P., de Souza Silva M.A. Differential susceptibility to extinction-induced despair and age-dependent alterations in hypothalamic-pituitary-adrenal axis and neurochemical parameters. Neuropsychobiology 2008, 58:138-153.
111. Trew J.L. Exploring the roles of approach and avoidance in depression: an integrative model. Clinical Psychology Review 2011, 31:1156-1168.
112. Willner P. Chronic mild stress (CMS) revisited: consistency and behavioural-neurobiological concordance in the effects of CMS. Neuropsychobiology 2005, 52:90-110.
113. Willner P., Mitchell P.J. The validity of animal models of predisposition to depression. Behavioral Pharmacology 2002, 13:169-188.
114. Willner P., Montgomery T., Bird D. Behavioural changes during withdrawal from desmethylimipramine (DM). II. Increased resistance to extinction. Psychopharmacology 1981, 75:60-64.
115. Willner O.P., Muscat R., Papp M. Chronic mild stress-induced anhedonia: a realistic animal model of depression. Neuroscience and Biobehavioral Reviews 1992, 16:525-534.
116. Willner P., Towell A. Evidence suggesting that DMI-induced resistance to extinction is not mediate by the dorsal noradrenergic bundle. Brain Research 1982, 22:251-253.
117. Winkler D., Pjerk E., Kasper S. Anger attacks in depression-evidence for a male depressive syndrome. Psychotherapy and Psychosomatics 2005, 74:303-307.