Social stress reactivity alters reward and punishment learning

Social Cognitive and Affective Neuroscience

Volumn 6, Issue 3, 2011, Pages 311-320

  Cavanagh, James F ^a   Frank, Michael J ^b   Allen, John J B ^a  

^a University of Arizona   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

Anterior cingulate; Computational psychiatry; EEG; Reinforcement learning; Social evaluative threat

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; BRAIN MAPPING; CINGULATE GYRUS; COGNITION; ELECTROENCEPHALOGRAPHY; FEEDBACK SYSTEM; FEMALE; HUMAN; LEARNING; MALE; MENTAL STRESS; METHODOLOGY; PATHOPHYSIOLOGY; PHYSIOLOGY; PREDICTIVE VALUE; PSYCHOLOGICAL ASPECT; PUNISHMENT; REINFORCEMENT; REWARD; SOCIAL BEHAVIOR;

ADOLESCENT; BRAIN MAPPING; COGNITION; ELECTROENCEPHALOGRAPHY; FEEDBACK; FEMALE; GYRUS CINGULI; HUMANS; LEARNING; MALE; PREDICTIVE VALUE OF TESTS; PUNISHMENT; REINFORCEMENT (PSYCHOLOGY); REWARD; SOCIAL BEHAVIOR; STRESS, PSYCHOLOGICAL; YOUNG ADULT;

EID: 79955770782     PISSN: 17495016     EISSN: 17495024     Source Type: Journal    
DOI: 10.1093/scan/nsq041     Document Type: Article

References (41)

1. Allen, J.J.B., Chambers, A.S., Towers, D.N. (2007). The many metrics of cardiac chronotropy: a pragmatic primer and a brief comparison of metrics. Biological Psychology, 74, 243-62.
2. Amat, J., Paul, E., Zarza, C., Watkins, L.R., Maier, S.F. (2006). Previous experience with behavioral control over stress blocks the behavioral and dorsal raphe nucleus activating effects of later uncontrollable stress: role of the ventral medial prefrontal cortex. Journal of Neuroscience, 26, 13264-72.
3. Amat, J., Baratta, M.V., Paul, E., Bland, S.T., Watkins, L.R., Maier, S.F. (2005). Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus. Nature Neuroscience, 8, 365-71.
4. Arnsten, A. (1998). Catecholamine modulation of prefrontal cortical cognitive function. Trends in Cognitive Sciences, 2, 11.
5. Behrens, T.E., Woolrich, M.W., Walton, M.E., Rushworth, M.F. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10, 1214-21.
6. Cabib, S., Puglisi-Allegra, S. (1994). Opposite responses of mesolimbic dopamine system to controllable and uncontrollable aversive experiences. Journal of Neuroscience, 14, 3333-40.
7. Carver, C.S., White, T.L. (1994). Behavioral-inhibition, behavioral activation, and affective responses to impending reward and punishment-the Bis Bas scales. Journal of Personality and Social Psychology, 67, 319-33.
8. Cavanagh, J.F., Allen, J.J.B. (2008). Multiple aspects of the stress response under social evaluative threat: an electrophysiological investigation. Psychoneuroendocrinology, 33,41-53.
9. Cavanagh, J.F., Allen, J.J.B. (2009). The Behavioural Inhibition System. In: Sander, D., Scherer, K.R., editors. The Oxford Companion to Emotion and the Affective Sciences. New York: Oxford University Press, pp. 73-4.
10. Cavanagh, J.F., Cohen, M.X., Allen, J.J.B. (2009). Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. Journal of Neuroscience, 29,98-105.
11. Cavanagh, J.F., Frank, M.J., Klein, T.J., Allen, J.J.B. (2010). Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. NeuroImage, 49, 3198-209.
12. Cohen, M.X., Ridderinkhof, K.R., Haupt, S., Elger, C.E., Fell, J. (2008). Medial frontal cortex and response conflict: evidence from human intracranial EEG and medial frontal cortex lesion. Brain Research, 1238, 127-42.
13. Debener, S., Ullsperger, M., Siegel, M., Fiehler, K., von Cramon, D.Y., Engel, A.K. (2005). Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. Journal of Neuroscience, 25, 11730-7.
14. Dedovic, K., D'Aguiar, C., Pruessner, J.C. (2009). What stress does to your brain: a review of neuroimaging studies. Canadian Journal of Psychiatry, 54,6-15.
15. Delorme, A, Makeig, S (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134,9-21.
16. Dickerson, S.S., Kemeny, M.E. (2004). Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. Psychological Bulletin, 130, 355-91.
17. Diorio, D., Viau, V., Meaney, M.J. (1993). The role of the medial prefrontal cortex (cingulate gyrus) in the regulation of hypothalamic-pituitary-adrenal responses to stress. Journal of Neuroscience, 13, 3839-47.
18. Doll, B.B., Jacobs, W.J., Sanfey, A.G., Frank, M.J. (2009). Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Research, 1299,74-94.
19. Frank, M.J., Seeberger, L.C., O'Reilly, R.C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science, 306, 1940-3.
20. Frank, M.J., Woroch, B.S., Curran, T. (2005). Error-related negativity predicts reinforcement learning and conflict biases. Neuron, 47, 495-501.
21. Frank, M.J., D'Lauro, C., Curran, T. (2007a). Cross-task individual differences in error processing: neural, electrophysiological, and genetic components. Cognitive Affect Behavior Neuroscience, 7, 297-308.
22. Frank, M.J., Santamaria, A., O'Reilly, R.C., Willcutt opharmacology, 32, 1583-99.
23. Frank, M.J., Moustafa, A.A., Haughey, H.M., Curran, T., Hutchison, K.E. (2007c). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of Natational Academy of Sciences of the United States of America, 104, 16311-6.
24. Gehring, W.J., Goss, B., Coles, M.G.H., Meyer, D.E., Donchin, E. (1993). A neural system for error-detection and compensation. Psychological Science, 4, 385-90.
25. Gross, J.J., Levenson, R.W. (1995). Emotion elicitation using films. Cognition & Emotion, 9,87-108.
26. Gründler, T.O.J., Cavanagh, J.F., Figueroa, C.M., Frank, M.J., Allen, J.J.B. (2009). Task-related dissociation in ERN amplitude as a function of obsessive-compulsive symptoms. Neuropsychologia, 47, 1978-87.
27. Holroyd, C.B., Coles, M.G. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychology Review, 109, 679-709.
28. Holroyd, C.B., Nieuwenhuis, S., Yeung, N., et al. (2004). Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nature Neuroscience, 7, 497-8.
29. Huys, Q.J., Dayan, P. (2009). A Bayesian formulation of behavioral control. Cognition, 113, 314-28.
30. Kayser, J., Tenke, C.E. (2006). Principal components analysis of Laplacian waveforms as a generic method for identifying ERP generator patterns: I. Evaluation with auditory oddball tasks. Clinical Neurophysiology, 117, 348-68.
31. Kemeny, M. (2003). The psychobiology of stress. Current Directions in Psychological Science, 12,4.
32. Krugel, L.K., Biele, G., Mohr, P.N.C., Li, S.C., Heekeren, H.R. (2009). Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions. Proceedings of the National Academy of Sciences of the United States of America, 106, 17951-6.
33. Lerner, J.S., Dahl, R.E., Hariri, A.R., Taylor, S.E. (2007). Facial expressions of emotion reveal neuroendocrine and cardiovascular stress responses. Biological Psychiatry, 61, 253-60.
34. Mars, R.B., Coles, M.G., Grol, M.J., et al. (2005). Neural dynamics of error processing in medial frontal cortex. Neuroimage, 28, 1007-13.
35. Pascucci, T., Ventura, R., Latagliata, E.C., Cabib, S., Puglisi-Allegra, S. (2007). The medial prefrontal cortex determines the accumbens dopamine response to stress through the opposing influences of norepinephrine and dopamine. Cerebral Cortex, 17, 2796-804.
36. Pruessner, J.C., Champagne, F., Meaney, M.J., Dagher, A. (2004). Dopamine release in response to a psychological stress in humans and its relationship to early life maternal care: a positron emission tomography study using [11C]raclopride. Journal of Neuroscience, 24, 2825-31.
37. Radley, J.J., Gosselink, K.L., Sawchenko, P.E. (2009). A discrete GABAergic relay mediates medial prefrontal cortical inhibition of the neuroendocrine stress response. Journal of Neuroscience, 29, 7330-40.
38. Soliman, A., O'Driscoll, G.A., Pruessner, J., et al. (2008). Stress-induced dopamine release in humans at risk of psychosis: a [11C]raclopride PET study. Neuropsychopharmacology, 33, 2033-41.
39. Sutton, R.S., Barto, A.G. (1998). Reinforcement Learning: An Introduction. Cambridge, Mass: MIT Press.
40. Trujillo, L.T., Allen, J.J. (2007). Theta EEG dynamics of the error-related negativity. Clinical Neurophysiology, 118, 645-68.
41. Watkins, C.J.C.H.D, P. (1992). Technical Note: Q-Learning. Machine Learning, 8, 279.