Acute stress selectively impairs learning to act

Scientific Reports

Volumn 6, Issue , 2016, Pages

  De Berker, Archy O ^a,b   Tirole, Margot ^a   Rutledge, Robb B ^b   Cross, Gemma F ^c   Dolan, Raymond J ^b   Bestmann, Sven ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c KING S COLLEGE HOSPITAL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; BIOLOGICAL MODEL; EXECUTIVE FUNCTION; FEMALE; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; MALE; PHYSIOLOGICAL STRESS; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PUNISHMENT; PUPIL; REACTION TIME; REWARD;

ALGORITHMS; CONDITIONING, OPERANT; EXECUTIVE FUNCTION; FEMALE; HUMANS; LEARNING; MALE; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; PUNISHMENT; PUPIL; REACTION TIME; REWARD; STRESS, PHYSIOLOGICAL;

EID: 84979030998     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep29816     Document Type: Article

References (64)

1. Joëls, M., Baram, T. Z. The neuro-symphony of stress. Nature Reviews Neuroscience 10, 459-466 (2009).
2. Schwabe, L., Wolf, O. T. Stress and multiple memory systems: from 'thinking' to "doing". Trends Cogn. Sci. (Regul. Ed.) 17, 60-68 (2013).
3. Schwabe, L., Tegenthoff, M., Hoffken, O., Wolf, O. T. Concurrent glucocorticoid and noradrenergic activity shifts instrumental behavior from goal-directed to habitual control. J. Neurosci. 30, 8190-8196 (2010).
4. Schwabe, L., Tegenthoff, M., Höffken, O., Wolf, O. T. Simultaneous glucocorticoid and noradrenergic activity disrupts the neural basis of goal-directed action in the human brain. J. Neurosci. 32, 10146-10155 (2012).
5. Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A., Daw, N. D. Working-memory capacity protects model-based learning from stress. Proceedings of the National Academy of Sciences 110, 20941-20946 (2013).
6. Schwabe, L., Wolf, O. T. Stress prompts habit behavior in humans. J. Neurosci. 29, 7191-7198 (2009).
7. Schwabe, L., Haddad, L., Schachinger, H. HPA axis activation by a socially evaluated cold-pressor test. Psychoneuroendocrinology 33, 890-895 (2008).
8. Guitart-Masip, M. et al. Action controls dopaminergic enhancement of reward representations. Proceedings of the National Academy of Sciences 109, 7511-7516 (2012).
9. Guitart-Masip, M. et al. Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage 62, 154-166 (2012).
10. Dayan, P., Niv, Y., Seymour, B., Daw, N. D. The misbehavior of value and the discipline of the will. Neural Networks 19, 1153-1160 (2006).
11. Guitart-Masip, M., Düzel, E., Dolan, R., Dayan, P. Action versus valence in decision making. Trends Cogn. Sci. (Regul. Ed.) 18, 194-202 (2014).
12. Hershberger, W. A. An approach through the looking-glass. Animal Learning \& Behavior 14, 443-451 (1986).
13. Fanselow, M. S. Conditional and unconditional components of post-shock freezing. Pav. J. Biol. Sci. 15, 177-182 (1980).
14. Berridge, K. C., Robinson, T. E., Aldridge, J. W. Dissecting components of reward: 'liking', 'wanting', learning. Curr Opin Pharmacol 9, 65-73 (2009).
15. Sinha, R. Chronic Stress, Drug Use, Vulnerability to Addiction. Annals of the New York Academy of Sciences 1141, 105-130 (2008).
16. Graf, E. N. et al. Corticosterone Acts in the Nucleus Accumbens to Enhance Dopamine Signaling and Potentiate Reinstatement of Cocaine Seeking. J. Neurosci. 33, 11800-11810 (2013).
17. Morgado, P., Silva, M., Sousa, N., Cerqueira, J. J. Stress Transiently Affects Pavlovian-to-Instrumental Transfer. Frontiers in Neuroscience 6, 93 (2012).
18. Pielock, S. M., Braun, S., Hauber, W. The effects of acute stress on Pavlovian-instrumental transfer in rats. Cognitive, affective\& behavioral neuroscience 13, 174-185 (2013).
19. Robinson, O. J., Krimsky, M., Grillon, C. The impact of induced anxiety on response inhibition. Front Hum Neurosci 7, (2013).
20. Murphy, P. R., O'Connell, R. G., O'Sullivan, M., Robertson, I. H., Balsters, J. H. Pupil diameter covaries with BOLD activity in human locus coeruleus. Hum Brain Mapp 35, 4140-4154 (2014).
21. Joshi, S., Li, Y., Kalwani, R. M., Gold, J. I. Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, Cingulate Cortex. Neuron 89, 221-234 (2016).
22. Varazzani, C., San-Galli, A., Gilardeau, S., Bouret, S. Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J. Neurosci. 35, 7866-7877 (2015).
23. Hermans, E. J. et al. Stress-related noradrenergic activity prompts large-scale neural network reconfiguration. Science 334, 1151-1153 (2011).
24. Campbell, J., Ehlert, U. Acute psychosocial stress: does the emotional stress response correspond with physiological responses Psychoneuroendocrinology 37, 1111-1134 (2012).
25. Guitart-Masip, M. et al. Differential, but not opponent, effects of L-DOPA and citalopram on action learning with reward and punishment. Psychopharmacology (Berl.) 231, 955-966 (2014).
26. Whiteside, S. P., Lynam, D. R. The five factor model and impulsivity: Using a structural model of personality to understand impulsivity. Personality and Individual Differences 669-689 (2001).
27. Norbury, A., Manohar, S., Rogers, R. D., Husain, M. Dopamine modulates risk-taking as a function of baseline sensation-seeking trait. J. Neurosci. 33, 12982-12986 (2013).
28. Gallistel, C. R., Fairhurst, S., Balsam, P. The learning curve: implications of a quantitative analysis. Proceedings of the National Academy of Sciences 101, 13124-13131 (2004).
29. Pruessner, J. C., Kirschbaum, C., Meinlschmid, G., Hellhammer, D. H. Two formulas for computation of the area under the curve represent measures of total hormone concentration versus time-dependent change. Psychoneuroendocrinology 28, 916-931 (2003).
30. Preuschoff, K., 't Hart, B. M., Einhaüser, W. Pupil dilation signals surprise: evidence for noradrenaline's role in decision making. Frontiers in Neuroscience 5, 115 (2011).
31. Nassar, M. R. et al. Rational regulation of learning dynamics by pupil-linked arousal systems. Nature Neuroscience 15, 1040-1046 (2012).
32. Browning, M., Behrens, T. E., Jocham, G., O'Reilly, J. X., Bishop, S. J. Anxious individuals have difficulty learning the causal statistics of aversive environments. Nature Neuroscience 18, 590-596 (2015).
33. Guitart-Masip, M. et al. Action controls dopaminergic enhancement of reward representations. Proceedings of the National Academy of Sciences 109, 7511-7516 (2012).
34. Watkins, C., Dayan, P. Q-learning. Machine Learning 8, 279-292 (1992).
35. Milani, P. et al. Cortisol-induced effects on human cortical excitability. Brain Stimulation 3, 131-139 (2010).
36. Sale, M. V., Ridding, M. C., Nordstrom, M. A. Cortisol Inhibits Neuroplasticity Induction in Human Motor Cortex. J. Neurosci. 28, 8285-8293 (2008).
37. Cavanagh, J. F., Eisenberg, I., Guitart-Masip, M., Huys, Q., Frank, M. J. Frontal Theta Overrides Pavlovian Learning Biases. J. Neurosci. 33, 8541-8548 (2013).
38. Kukolja, J. et al. Modeling a negative response bias in the human amygdala by noradrenergic-glucocorticoid interactions. J. Neurosci. 28, 12868-12876 (2008).
39. Roozendaal, B., Okuda, S., de Quervain, D. J. F., McGaugh, J. L. Glucocorticoids interact with emotion-induced noradrenergic activation in influencing different memory functions. Neuroscience 138, 901-910 (2006).
40. Barsegyan, A., Mackenzie, S. M., Kurose, B. D., McGaugh, J. L., Roozendaal, B. Glucocorticoids in the prefrontal cortex enhance memory consolidation and impair working memory by a common neural mechanism. Proceedings of the National Academy of Sciences 107, 16655-16660 (2010).
41. McCall, J. G. et al. CRH Engagement of the Locus Coeruleus Noradrenergic System Mediates Stress-Induced Anxiety. Neuron 87, 605-620 (2015).
42. de Berker, A. O. et al. Computations of uncertainty mediate acute stress responses in humans. Nat Comms 7, 10996 (2016).
43. Rutledge, R. B., Skandali, N., Dayan, P., Dolan, R. J. A computational and neural model of momentary subjective well-being. Proceedings of the National Academy of Sciences 111, 12252-12257 (2014).
44. Quail, S. L., Morris, R. W., Balleine, B. W. Stress associated changes in Pavlovian-instrumental transfer in humans. Q J Exp Psychol (Hove) 1-11, doi: 10.1080/17470218.2016.1149198 (2016).
45. Joëls, M., Pu, Z., Wiegert, O., Oitzl, M. S., Krugers, H. J. Learning under stress: how does it work Trends Cogn. Sci. (Regul. Ed.) 10, 152-158 (2006).
46. Petzold, A., Plessow, F., Goschke, T., Kirschbaum, C. Stress reduces use of negative feedback in a feedback-based learning task. Behav. Neurosci. 124, 248-255 (2010).
47. Lighthall, N. R., Gorlick, M. A., Schoeke, A., Frank, M. J., Mather, M. Stress modulates reinforcement learning in younger and older adults. Psychol Aging 28, 35-46 (2013).
48. Hunt, L. T., Woolrich, M. W., Rushworth, M. F. S., Behrens, T. E. J. Trial-type dependent frames of reference for value comparison. PLoS Comp Biol 9, e1003225 (2013).
49. Seligman, M., Maier, S. F. Failure to escape traumatic shock. Journal of Experimental Psychology 74, 1-9 (1967).
50. Minor, T. R., Jackson, R. L., Maier, S. F. Effects of task-irrelevant cues and reinforcement delay on choice-escape learning following inescapable shock: Evidence for a deficit in selective attention. Journal of Experimental Psychology: Animal Behavior Processes 10, 543-556 (1984).
51. Lieder, F., Goodman, N. D., Huys, Q. J. Learned helplessness and generalization. Paper presented at the Cognitive Science Conference, Berlin, Germany (2013).
52. Koolhaas, J. M. et al. Stress revisited: a critical evaluation of the stress concept. Neurosci Biobehav Rev 35, 1291-1301 (2011).
53. Leedy, M. G., Wilson, M. S. Testosterone and cortisol levels in crewmen of US Air Force fighter and cargo planes. Psychosom Med (1985).
54. Sluiter, J. K. Medical staff in emergency situations: severity of patient status predicts stress hormone reactivity and recovery. Occupational and Environmental Medicine 60, 373-375 (2003).
55. Coates, J. M., Herbert, J. Endogenous steroids and financial risk taking on a London trading floor. Proceedings of the National Academy of Sciences 105, 6167-6172 (2008).
56. Kirschbaum, C., Hellhammer, D. H. Salivary cortisol in psychobiological research: an overview. Neuropsychobiology 22, 150-169 (1989).
57. Schoofs, D., Wolf, O. T., Smeets, T. Cold pressor stress impairs performance on working memory tasks requiring executive functions in healthy young men. Behav. Neurosci. 123, 1066-1075 (2009).
58. Bullinger, M. et al. Endocrine effects of the cold pressor test: relationships to subjective pain appraisal and coping. Psychiatry research 12, 227-233 (1984).
59. McEwen, B. S. Physiology and neurobiology of stress and adaptation: central role of the brain. Physiological reviews 87, 873-904 (2007).
60. Csikszentmihalyi, M., Larson, R. Validity and reliability of the Experience-Sampling Method. The Journal of nervous and mental disease (1987).
61. de Gee, J. W., Knapen, T., Donner, T. H. Decision-related pupil dilation reflects upcoming choice and individual bias. Proceedings of the National Academy of Sciences 111, E618-25 (2014).
62. Arakawa, H., Maeda, M., Tsuji, A. Chemiluminescence enzyme immunoassay of cortisol using peroxidase as label. Analytical Biochemistry 97, 248-254 (1979).
63. Benjamini, Y., Hochberg, Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B. (1995).
64. Huys, Q. J. M. et al. Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding. PLoS Comp Biol 7, e1002028 (2011).