The temporal dynamics of reversal learning: P3 amplitude predicts valence-specific behavioral adjustment

Physiology and Behavior

Volumn 161, Issue , 2016, Pages 24-32

  Donaldson, Kayla R ^a   Ait Oumeziane, Belel ^a   Hélie, Sebastien ^a   Foti, Dan ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

ERP; Flexibility; Punishment; Reversal learning; Reward

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; BEHAVIOR; DYNAMICS; FEMALE; HUMAN; LEARNING; MALE; PRIORITY JOURNAL; REWARD; TEMPORAL DYNAMICS; ADAPTIVE BEHAVIOR; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEEDBACK SYSTEM; NONLINEAR SYSTEM; PHOTOSTIMULATION; PHYSIOLOGY; PUNISHMENT; YOUNG ADULT;

ADAPTATION, PSYCHOLOGICAL; ADOLESCENT; ADULT; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK; FEMALE; HUMANS; MALE; NONLINEAR DYNAMICS; PHOTIC STIMULATION; PUNISHMENT; REVERSAL LEARNING; REWARD; YOUNG ADULT;

EID: 84962905921     PISSN: 00319384     EISSN: 1873507X     Source Type: Journal    
DOI: 10.1016/j.physbeh.2016.03.034     Document Type: Article

References (44)

1. Ashby F.G., Helie S. A tutorial on computational cognitive neuroscience: modeling the neurodynamics of cognition. J. Math. Psychol. 2011, 55:273-289.
2. Becker M.P., Nitsch A.M., Miltner W.H., Straube T. A single-trial estimation of the feedback-related negativity and its relation to BOLD responses in a time-estimation task. J. Neurosci. 2014, 34(8):3005-3012.
3. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 191(3):391-431.
4. Bruder G.E., Kayser J., Tenke C.E. Event-related brain potentials in depression: clinical, cognitive and neurophysiologic implications. The Oxford Handbook of Event-Related Potential Components 2012, Vol. 2012:563-592.
5. Carlson J.M., Foti D., Mujica-Parodi L.R., Harmon-Jones E., Hajcak G. Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: a combined ERP and fMRI study. NeuroImage 2011, 57(4):1608-1616.
6. Chase H.W., Swainson R., Durham L., Benham L., Cools R. Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. J. Cogn. Neurosci. 2011, 23(4):936-946. 10.1162/jocn.2010.21456.
7. Codispoti M., Ferrari V., Bradley M.M. Repetition and event-related potentials: distinguishing early and late processes in affective picture perception. J. Cogn. Neurosci. 2007, 19(4):577-586. 10.1162/jocn.2007.19.4.577.
8. Cools R., Altamirano L., D'Esposito M. Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 2006, 44(10):1663-1673. 10.1016/j.neuropsychologia.2006.03.030.
9. Cools R., Clark L., Owen A.M., Robbins T.W. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J. Neurosci. 2002, 22(11):4563-4567.
10. Cools R., Lewis S.J.G., Clark L., Barker R.A., Robbins T.W. L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 2006, 32(1):180-189. 10.1038/sj.npp.1301153.
11. Courchesne E., Hillyard S.A., Galambos R. Stimulus novelty, task relevance and the visual evoked potential in man. Electroencephalogr. Clin. Neurophysiol. 1975, 39(2):131-143.
12. Donchin E., Coles M.G.H. Is the P300 component a manifestation of context updating?. Behav. Brain Sci. 1988, 11(03):357-374. 10.1017/S0140525X00058027.
13. Foti D., Hajcak G., Dien J. Differentiating neural responses to emotional pictures: evidence from temporal-spatial PCA. Psychophysiology 2009, 46(3):521-530.
14. Foti D., Weinberg A., Dien J., Hajcak G. Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: temporospatial principal components analysis and source localization of the feedback negativity. Hum. Brain Mapp. 2011, 32(12):2207-2216. 10.1002/hbm.21182.
15. Gehring W.J., Willoughby A.R. The medial frontal cortex and the rapid processing of monetary gains and losses. Science 2002, 295(5563):2279-2282. 10.1126/science.1066893.
16. Gratton G., Coles M.G., Donchin E. A new method for off-line removal of ocular artifact. Electroencephalogr. Clin. Neurophysiol. 1983, 55(4):468-484.
17. Hajcak G., Dunning J.P., Foti D. Motivated and controlled attention to emotion: time-course of the late positive potential. Clin. Neurophysiol. 2009, 120(3):505-510. 10.1016/j.clinph.2008.11.028.
18. Hajcak G., Olvet D.M. The persistence of attention to emotion: brain potentials during and after picture presentation. Emotion 2008, 8(2):250-255. 10.1037/1528-3542.8.2.250.
19. Healy G.F., Boran L., Smeaton A.F. Neural patterns of the implicit association test. Front. Hum. Neurosci. 2015, 9.
20. Helie S., Ell S.W., Ashby F.G. Learning robust cortico-frontal associations with the basal ganglia: an integrative review. Cortex 2015, 64:123-135.
21. Helie S., Paul E.J., Ashby F.G. Simulating the effect of dopamine imbalance on cognition: from positive affect to Parkinson's disease. Neural Netw. 2012, 32:74-85.
22. Hewig J., Kretschmer N., Trippe R.H., Hecht H., Coles M.G., Holroyd C.B., Miltner W.H. Hypersensitivity to reward in problem gamblers. Biol. Psychiatry 2010, 67(8):781-783.
23. Holroyd C.B., Pakzad-Vaezi K.L., Krigolson O.E. The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology 2008, 45(5):688-697. 10.1111/j.1469-8986.2008.00668.x.
24. Lang P., Bradley M., Cuthbert B. International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual (Tech Report A-6) 2005, University of Florida. Center for Research in Psychophysiology, Gainesville.
25. Luck S.J. An Introduction to the Event-related Potential Technique 2014, MIT press.
26. Marco-Pallarés J., Krämer U.M., Strehl S., Schröder A., Münte T.F. When decisions of others matter to me: an electrophysiological analysis. BMC Neurosci. 2010, 11(1):86.
27. Miltner W.H., Braun C.H., Coles M.G. Event-related brain potentials following incorrect feedback in a time-estimation task: evidence for a "generic" neural system for error detection. J. Cogn. Neurosci. 1997, 9(6):788-798. 10.1162/jocn.1997.9.6.788.
28. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 1996, 16(5):1936-1947.
29. Novak K.D., Foti D. Teasing apart the anticipatory and consummatory processing of monetary incentives: an event-related potential study of reward dynamics. Psychophysiology 2015, 52(11):1470-1482.
30. Patterson J., Holland J., Middleton R. Neuropsychological performance, impulsivity, and comorbid psychiatric illness in patients with pathological gambling undergoing treatment at the CORE inpatient treatment Center. South. Med. J. 2006, 99(1):36-43.
31. Patzelt E.H., Kurth-Nelson Z., Lim K.O., MacDonald A.W. Excessive state switching underlies reversal learning deficits in cocaine users. Drug Alcohol Depend. 2014, 134. 10.1016/j.drugalcdep.2013.09.029.
32. Proudfit G.H. The reward positivity: from basic research on reward to a biomarker for depression. Psychophysiology 2015, 52(4):449-459. 10.1111/psyp.12370.
33. Remijnse P.L., Nielen M.M.A., van Balkom A.J.L.M., Hendriks G.-J., Hoogendijk W.J., Uylings H.B.M., Veltman D.J. Differential frontal-striatal and paralimbic activity during reversal learning in major depressive disorder and obsessive-compulsive disorder. Psychol. Med. 2009, 39(09):1503-1518. 10.1017/S0033291708005072.
34. Robinson O.J., Cools R., Carlisi C.O., Sahakian B.J., Drevets W.C. Ventral striatum response during reward and punishment reversal learning in Unmedicated major depressive disorder. Am. J. Psychiatr. 2012, 169(2):152-159. 10.1176/appi.ajp.2011.11010137.
35. Robinson O.J., Frank M.J., Sahakian B.J., Cools R. Dissociable responses to punishment in distinct striatal regions during reversal learning. NeuroImage 2010, 51(4):1459-1467. 10.1016/j.neuroimage.2010.03.036.
36. San Martín R., Appelbaum L.G., Pearson J.M., Huettel S.A., Woldorff M.G. Rapid brain responses independently predict gain maximization and loss minimization during economic decision making. J. Neurosci. 2013, 33(16):7011-7019.
37. Schultz W., Dayan P., Montague R.R.A. Neural substrate of prediction and reward. Science 1997, 275:1593-1599.
38. Torres A., Catena A., Cándido A., Maldonado A., Megías A., Perales J.C. Cocaine dependent individuals and gamblers present different Associative learning Anomalies in feedback-driven decision making: A behavioral and ERP study. Front. Psychol. 2013, 4:122. 10.3389/fpsyg.2013.00122.
39. von Borries A.K.L., Verkes R.J., Bulten B.H., Cools R., de Bruijn E.R.A. Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning. Cogn. Affect. Behav. Neurosci. 2013, 13(4):737-746. 10.3758/s13415-013-0150-1.
40. Weiler J., Hassall C.D., Krigolson O.E., Heath M. The unidirectional prosaccade switch-cost: Electroencephalographic evidence of task-set inertia in oculomotor control. Behav. Brain Res. 2015, 278:323-329.
41. Weinberg A., Hajcak G. Beyond good and evil: the time-course of neural activity elicited by specific picture content. Emotion 2010, 10(6):767-782. 10.1037/a0020242.
42. Pizzagalli D.A. Depression, stress, and anhedonia: toward a synthesis and integrated model. Annual Review of Clinical Psychology 2014, 10:393-423.
43. Treadway M.T., Zald D.H. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neuroscience & Biobehavioral Reviews 2011, 35(3):537-555.
44. Kumar P., Waiter G., Ahearn T., Milders M., Reid I., Steele J.D. Abnormal temporal difference reward-learning signals in major depression. Brain 2008, 131:2084-2093.