Working-memory capacity protects model-based learning from stress

Proceedings of the National Academy of Sciences of the United States of America

Volumn 110, Issue 52, 2013, Pages 20941-20946

  Otto, A Ross ^a   Raio, Candace M ^a   Chiang, Alice ^a   Phelps, Elizabeth A ^a,b   Daw, Nathaniel D ^a  

^a NEW YORK UNIVERSITY   (United States)

^b NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HYDROCORTISONE;

ACUTE STRESS; ADULT; ARTICLE; BEHAVIOR CHANGE; CONTROLLED STUDY; DECISION MAKING; EXECUTIVE FUNCTION; FEMALE; HUMAN; HYPOTHALAMUS HYPOPHYSIS ADRENAL SYSTEM; LEARNING; MALE; MODEL BASED LEARNING; PREFRONTAL CORTEX; PRIORITY JOURNAL; STRESS; WORKING MEMORY;

EID: 84891354506     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1312011110     Document Type: Article

References (47)

1. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8(12): 1704-1711.
2. Kahneman D, Frederick S (2002) Heuristics and Biases: The Psychology of Intuitive Judgment, eds Gilovich T, Griffin D, Kahneman D (Cambridge Univ Press, Cambridge, UK), pp 49-81.
3. Sloman SA (1996) The empirical case for two systems of reasoning. Psychol Bull 119(1): 3-22.
4. Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35(1): 48-69.
5. Redish AD, Jensen S, Johnson A (2008) A unified framework for addiction: Vulnerabilities in the decision process. Behav Brain Sci 31(4): 415-437.
6. Everitt BJ, Robbins TW (2005) Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nat Neurosci 8(11): 1481-1489.
7. Arnsten AFT (2009) Stress signalling pathways that impair prefrontal cortex structure and function. Nat Rev Neurosci 10(6): 410-422.
8. Leder J, Häusser JA, Mojzisch A (2013) Stress and strategic decision-making in the beauty contest game. Psychoneuroendocrinology 38(9): 1503-1511.
9. Pabst S, Brand M, Wolf OT (2013) Stress and decision making: A few minutes make all the difference. Behav Brain Res 250: 39-45.
10. Porcelli AJ, Delgado MR (2009) Acute stress modulates risk taking in financial decision making. Psychol Sci 20(3): 278-283.
11. Putman P, Antypa N, Crysovergi P, van der Does WAJ (2010) Exogenous cortisol acutely influences motivated decision making in healthy young men. Psychopharmacology (Berl) 208(2): 257-263.
12. Schwabe L, Wolf OT (2011) Stress-induced modulation of instrumental behavior: from goal-directed to habitual control of action. Behav Brain Res 219(2): 321-328.
13. Starcke K, Wolf OT, Markowitsch HJ, Brand M (2008) Anticipatory stress influences decision making under explicit risk conditions. Behav Neurosci 122(6): 1352-1360.
14. Frank MJ, Seeberger LC, O'reilly RC (2004) By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science 306(5703): 1940-1943.
15. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16(5): 1936-1947.
16. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69(6): 1204-1215.
17. Gershman SJ, Markman AB, Otto AR (2012) Retrospective revaluation in sequential decision making: A tale of two systems. J Exp Psychol Gen, in press.
18. Gläscher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66(4): 585-595.
19. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275(5306): 1593-1599.
20. Keramati M, Dezfouli A, Piray P (2011) Speed/accuracy trade-off between the habitual and the goal-directed processes. PLOS Comput Biol 7(5):e1002055.
21. Otto AR, Gershman SJ, Markman AB, Daw ND (2013) The curse of planning: Dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol Sci 24(5): 751-761.
22. Lupien SJ, Gillin CJ, Hauger RL (1999) Working memory is more sensitive than declarative memory to the acute effects of corticosteroids: A dose-response study in humans. Behav Neurosci 113(3): 420-430.
23. Schoofs D, Wolf OT, Smeets T (2009) Cold pressor stress impairs performance on working memory tasks requiring executive functions in healthy young men. Behav Neurosci 123(5): 1066-1075.
24. Qin S, Hermans EJ, van Marle HJF, Luo J, Fernández G (2009) Acute psychological stress reduces working memory-related activity in the dorsolateral prefrontal cortex. Biol Psychiatry 66(1): 25-32.
25. Schwabe L, Wolf OT (2009) Stress prompts habit behavior in humans. J Neurosci 29(22): 7191-7198.
26. Schwabe L, et al. (2007) Stress modulates the use of spatial versus stimulus-response learning strategies in humans. Learn Mem 14(1): 109-116.
27. Anstrom KK, Woodward DJ (2005) Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology 30(10): 1832-1840.
28. Abercrombie ED, Keefe KA, DiFrischia DS, Zigmond MJ (1989) Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. J Neurochem 52(5): 1655-1658.
29. Petzold A, Plessow F, Goschke T, Kirschbaum C (2010) Stress reduces use of negative feedback in a feedback-based learning task. Behav Neurosci 124(2): 248-255.
30. Lighthall NR, Gorlick MA, Schoeke A, Frank MJ, Mather M (2013) Stress modulates reinforcement learning in younger and older adults. Psychol Aging 28(1): 35-46.
31. Conway ARA, Kane MJ, Engle RW (2003) Working memory capacity and its relation to general intelligence. Trends Cogn Sci 7(12): 547-552.
32. McRae AL, et al. (2006) Stress reactivity: Biological and subjective responses to the cold pressor and Trier Social stressors. Hum Psychopharmacol 21(6): 377-385.
33. Lee MD (2011) How cognitive modeling can benefit from hierarchical Bayesian models. J Math Psychol 55(1): 1-7.
34. Smittenaar P, Fitzgerald THB, Romei V, Wright ND, Dolan RJ (2013) Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans [published online ahead of print on October 22, 2013]. Neuron, 10.1016/j. neuron.2013.08.009.
35. Wunderlich K, Smittenaar P, Dolan RJ (2012) Dopamine enhances model-based over model-free choice behavior. Neuron 75(3): 418-424.
36. Starcke K, Brand M (2012) Decision making under stress: A selective review. Neurosci Biobehav Rev 36(4): 1228-1248.
37. Shamosh NA, et al. (2008) Individual differences in delay discounting: Relation to intelligence, working memory, and anterior prefrontal cortex. Psychol Sci 19(9): 904-911.
38. Bickel WK, Jarmolowicz DP, Mueller ET, Gatchalian KM, McClure SM (2012) Are executive function and impulsivity antipodes? A conceptual reconstruction with special reference to addiction. Psychopharmacology (Berl) 221(3): 361-387.
39. Peters J, Büchel C (2011) The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci 15(5): 227-239.
40. Stern Y (2009) Cognitive reserve. Neuropsychologia 47(10): 2015-2028.
41. Butts KA, Weinberg J, Young AH, Phillips AG (2011) Glucocorticoid receptors in the prefrontal cortex regulate stress-evoked dopamine efflux and aspects of executive function. Proc Natl Acad Sci USA 108(45): 18459-18464.
42. Nagano-Saito A, et al. (2013) Stress-induced dopamine release in human medial prefrontal cortex-(18) F-Fallypride/PET study in healthy volunteers. Synapse 67(12): 821-830.
43. Cools R, D'Esposito M (2011) Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol Psychiatry 69(12):e113-e125.
44. Mather M, Lighthall NR (2012) Both Risk and Reward are Processed Differently in Decisions Made Under Stress. Curr Dir Psychol Sci 21(2): 36-41.
45. Sinha R (2001) How does stress increase risk of drug abuse and relapse? Psychopharmacology (Berl) 158(4): 343-359.
46. Steinhauser M, Maier M, Hübner R (2007) Cognitive control under stress: How stress affects strategies of task-set reconfiguration. Psychol Sci 18(6): 540-545.
47. Unsworth N, Heitz RP, Schrock JC, Engle RW (2005) An automated version of the operation span task. Behav Res Methods 37(3): 498-505.