The interaction of acute and chronic stress impairs model-based behavioral control

Psychoneuroendocrinology

Volumn 53, Issue , 2015, Pages 268-280

  Radenbach, Christoph ^a   Reiter, Andrea M F ^a,b   Engert, Veronika ^a   Sjoerds, Zsuzsika ^a   Villringer, Arno ^a,c,d,e   Heinze, Hans Jochen ^f,g   Deserno, Lorenz ^a,g,h   Schlagenhauf, Florian ^a,h  

^a MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^b and Plasticity   (Germany)

^c UNIVERSITY HOSPITAL LEIPZIG   (Germany)

^d UNIVERSITY OF LEIPZIG   (Germany)

^e HUMBOLDT UNIVERSITY   (Germany)

^f LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

^g OTTO VON GUERICKE UNIVERSITY   (Germany)

^h CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

Author keywords

Acute chronic stress; Behavioral control; Computational modeling; Cortisol; Model based model free decision making; Reinforcement learning

Indexed keywords

HYDROCORTISONE;

ACUTE STRESS; ADULT; ARTICLE; BEHAVIOR CONTROL; CHRONIC STRESS; CONTROLLED STUDY; DECISION MAKING; HEART RATE; HUMAN; HUMAN EXPERIMENT; HYDROCORTISONE BLOOD LEVEL; LIFE STRESS; LONG TERM EXPOSURE; MALE; MENTAL STRESS; NORMAL HUMAN; PREDICTION; REINFORCEMENT; TASK PERFORMANCE; VULNERABLE POPULATION; ACUTE DISEASE; CHEMISTRY; CHRONIC DISEASE; CROSSOVER PROCEDURE; HABIT; METABOLISM; PATHOPHYSIOLOGY; PHYSIOLOGICAL STRESS; PHYSIOLOGY; PSYCHOLOGY; SALIVA; YOUNG ADULT;

ACUTE DISEASE; ADULT; CHRONIC DISEASE; CROSS-OVER STUDIES; DECISION MAKING; HABITS; HEART RATE; HUMANS; HYDROCORTISONE; MALE; SALIVA; STRESS, PHYSIOLOGICAL; STRESS, PSYCHOLOGICAL; YOUNG ADULT;

EID: 84922804295     PISSN: 03064530     EISSN: 18733360     Source Type: Journal    
DOI: 10.1016/j.psyneuen.2014.12.017     Document Type: Article

References (55)

1. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
2. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
3. Bechara A., Damasio H., Tranel D., Damasio A.R. Deciding advantageously before knowing the advantageous strategy. Science 1997, 275:1293-1295.
4. Bechara A., Tranel D., Damasio H., Damasio A.R. Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. Cereb. Cortex 1996, 6:215-225.
5. Campbell J., Ehlert U. Acute psychosocial stress: does the emotional stress response correspond with physiological responses?. Psychoneuroendocrinology 2012, 37:1111-1134.
6. Cohen J. Statistical Power Analysis for the Behavioral Sciences 1988, Erlbaum, Hillsdale, NJ. 2nd ed.
7. Cohen S., Kamarck T., Mermelstein R. A global measure of perceived stress. J. Health Soc. Behav. 1983, 24:385-396.
8. Critchley D.R. Genetic, biochemical and structural approaches to talin function. Biochem. Soc. Trans. 2005, 33:1308-1312.
9. Dalbert C. ASTS - Aktuelle Stimmungsskala 1992, http://www.erzwiss.uni-halle.de/gliederung/paed/ppsych/sdasts.pdf.
10. Damasio A.R. The Feeling of What Happens: Body and Emotion in the Making of Consciousness 1999, Harcourt Incorporated, New York.
11. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
12. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
13. Dias-Ferreira E., Sousa J.C., Melo I., Morgado P., Mesquita A.R., Cerqueira J.J., Costa R.M., Sousa N. Chronic stress causes frontostriatal reorganization and affects decision-making. Science 2009, 325:621-625.
14. Dolan R.J., Dayan P. Goals and habits in the brain. Neuron 2013, 80:312-325.
15. Eppinger B., Walter M., Heekeren H.R., Li S.C. Of goals and habits: age-related and individual differences in goal-directed decision-making. Front. Neurosci. 2013, 7:253.
16. Friedel E., Koch S.P., Wendt J., Heinz A., Deserno L., Schlagenhauf F. Devaluation and sequential decisions: linking goal-directed and model-based behavior. Front. Human Neurosci. 2014, 8:587.
17. Gluck M.E. Stress response and binge eating disorder. Appetite 2006, 46:26-30.
18. Gluck M.E., Geliebter A., Hung J., Yahav E. Cortisol, hunger, and desire to binge eat following a cold stress test in obese women with binge eating disorder. Psychosom. Med. 2004, 66:876-881.
19. Holmes T.H., Rahe R.H. The Social Readjustment Rating Scale. J. Psychosom. Res. 1967, 11:213-218.
20. Huys Q.J., Cools R., Golzer M., Friedel E., Heinz A., Dolan R.J., Dayan P. Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Comput. Biol. 2011, 7:e1002028.
21. Huys Q.J., Eshel N., O'Nions E., Sheridan L., Dayan P., Roiser J.P. Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Comput. Biol. 2012, 8:e1002410.
22. Kirschbaum C., Pirke K.M., Hellhammer D.H. The 'Trier Social Stress Test' - a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 1993, 28:76-81.
23. Koob G.F. A role for brain stress systems in addiction. Neuron 2008, 59:11-34.
24. Kudielka B.M., Hellhammer D.H., Kirschbaum C. Ten years of research with the Trier Social Stress Test - revisited. Social Neuroscience: Integrating Biological and Psychological Explanations of Social Behavior 2007, 56-83. The Guilford Press, New York. E. Harmon-Jones, P. Winkielman (Eds.).
25. Kudielka B.M., Schommer N.C., Hellhammer D.H., Kirschbaum C. Acute HPA axis responses, heart rate, and mood changes to psychosocial stress (TSST) in humans at different times of day. Psychoneuroendocrinology 2004, 29:983-992.
26. Laux L., Glanzmann P., Schaffner P., Spielberger C. Das State-Trait-Angstinventar 1981, Beltz, Weinheim.
27. Liston C., McEwen B.S., Casey B.J. Psychosocial stress reversibly disrupts prefrontal processing and attentional control. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:912-917.
28. Luine V., Villegas M., Martinez C., McEwen B.S. Repeated stress causes reversible impairments of spatial memory performance. Brain Res. 1994, 639:167-170.
29. Lupien S.J., McEwen B.S., Gunnar M.R., Heim C. Effects of stress throughout the lifespan on the brain, behaviour and cognition. Nat. Rev. Neurosci. 2009, 10:434-445.
30. McEwen B.S. Protection and damage from acute and chronic stress: allostasis and allostatic overload and relevance to the pathophysiology of psychiatric disorders. Ann. N.Y. Acad. Sci. 2004, 1032:1-7.
31. McNair D., Lorr M., Droppleman L. Manual for the Profile of Mood States 1971, Educational and Industrial Testing Services, San Diego.
32. Mendelson J.H., Sholar M.B., Goletiani N., Siegel A.J., Mello N.K. Effects of low- and high-nicotine cigarette smoking on mood states and the HPA axis in men. Neuropsychopharmacology 2005, 30:1751-1763.
33. Otto A.R., Gershman S.J., Markman A.B., Daw N.D. The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol. Sci. 2013, 24:751-761.
34. Otto A.R., Raio C.M., Chiang A., Phelps E.A., Daw N.D. Working-memory capacity protects model-based learning from stress. Proc. Natl. Acad. Sci. U. S. A. 2013, 110:20941-20946.
35. Petzold A., Plessow F., Goschke T., Kirschbaum C. Stress reduces use of negative feedback in a feedback-based learning task. Behav. Neurosci. 2010, 124:248-255.
36. Plessow F., Fischer R., Kirschbaum C., Goschke T. Inflexibly focused under stress: acute psychosocial stress increases shielding of action goals at the expense of reduced cognitive flexibility with increasing time lag to the stressor. J. Cogn. Neurosci. 2011, 23:3218-3227.
37. Plessow F., Kiesel A., Kirschbaum C. The stressed prefrontal cortex and goal-directed behaviour: acute psychosocial stress impairs the flexible implementation of task goals. Exp. Brain Res. 2012, 216:397-408.
38. Russell J.A., Weiss A., Mendelsohn G.A. Affect grid - a single-item scale of pleasure and arousal. J. Pers. Soc. Psychol. 1989, 57:493-502.
39. Schommer N.C., Hellhammer D.H., Kirschbaum C. Dissociation between reactivity of the hypothalamus-pituitary-adrenal axis and the sympathetic-adrenal-medullary system to repeated psychosocial stress. Psychosom. Med. 2003, 65:450-460.
40. Schwabe L., Wolf O.T. Stress prompts habit behavior in humans. J. Neurosci. 2009, 29:7191-7198.
41. Schwabe L., Wolf O.T. Stress-induced modulation of instrumental behavior: from goal-directed to habitual control of action. Behav. Brain Res. 2011, 219:321-328.
42. Schwabe L., Wolf O.T. Stress and multiple memory systems: from 'thinking' to 'doing'. Trends Cogn. Sci. 2013, 17:60-68.
43. Sebold M., Deserno L., Nebe S., Schad D.J., Garbusow M., Hagele C., Keller J., Junger E., Kathmann N., Smolka M., Rapp M.A., Schlagenhauf F., Heinz A., Huys Q.J. Model-based and model-free decisions in alcohol dependence. Neuropsychobiology 2014, 70:122-131.
44. Smittenaar P., FitzGerald T.H., Romei V., Wright N.D., Dolan R.J. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron 2013, 80:914-919.
45. Soares J.M., Sampaio A., Ferreira L.M., Santos N.C., Marques F., Palha J.A., Cerqueira J.J., Sousa N. Stress-induced changes in human decision-making are reversible. Transl. Psychiatry 2012, 2:e131.
46. Starcke K., Brand M. Decision making under stress: a selective review. Neurosci. Biobehav. Rev. 2012, 36:1228-1248.
47. Starcke K., Polzer C., Wolf O.T., Brand M. Does stress alter everyday moral decision-making?. Psychoneuroendocrinology 2011, 36:210-219.
48. Stephan K.E., Penny W.D., Daunizeau J., Moran R.J., Friston K.J. Bayesian model selection for group studies. Neuroimage 2009, 46:1004-1017.
49. Tse Y.C., Montoya I., Wong A.S., Mathieu A., Lissemore J., Lagace D.C., Wong T.P. A longitudinal study of stress-induced hippocampal volume changes in mice that are susceptible or resilient to chronic social defeat. Hippocampus 2014, 24:1120-1128.
50. Valentin V.V., Dickinson A., O'Doherty J.P. Determining the neural substrates of goal-directed learning in the human brain. J. Neurosci. 2007, 27:4019-4026.
51. Van Cauter E., Refetoff S. Evidence for two subtypes of Cushing's disease based on the analysis of episodic cortisol secretion. N. Engl. J. Med. 1985, 312:1343-1349.
52. Von Aster M., Neubauer A., Horn R. Wechsler Intelligenztest für Erwachsene 2006, Harcourt Test Services, Frankfurt.
53. Voon V., Derbyshire K., Ruck C., Irvine M.A., Worbe Y., Enander J., Schreiber L.R., Gillan C., Fineberg N.A., Sahakian B.J., Robbins T.W., Harrison N.A., Wood J., Daw N.D., Dayan P., Grant J.E., Bullmore E.T. Disorders of compulsivity: a common bias towards learning habits. Mol. Psychiatry 2014, (epub ahead of print).
54. Wechsler D. A standardized memory scale for clinical use. J. Psychol. 1945, 19:87-95.
55. Wunderlich K., Smittenaar P., Dolan R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 2012, 75:418-424.