Better late than never? The effect of feedback delay on ERP indices of reward processing

Cognitive, Affective and Behavioral Neuroscience

Volumn 12, Issue 4, 2012, Pages 671-677

  Weinberg, Anna ^a   Luhmann, Christian C ^a   Bress, Jennifer N ^a   Hajcak, Greg ^a  

^a STONY BROOK UNIVERSITY   (United States)

Author keywords

ERP; Reward

Indexed keywords

ADAPTIVE BEHAVIOR; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; ARTICLE; BRAIN MAPPING; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; FEMALE; GAME; HUMAN; MALE; PHYSIOLOGY; REACTION TIME; REWARD; TIME;

ADOLESCENT; ANALYSIS OF VARIANCE; BRAIN MAPPING; CHOICE BEHAVIOR; ELECTROENCEPHALOGRAPHY; EVENT-RELATED POTENTIALS, P300; FEEDBACK, PSYCHOLOGICAL; FEMALE; GAMES, EXPERIMENTAL; HUMANS; MALE; REACTION TIME; REWARD; TIME FACTORS; YOUNG ADULT;

EID: 84870922429     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13415-012-0104-z     Document Type: Article

References (48)

1. Baker, T., & Holroyd, C. (2011). Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200. Biological Psychology, 87, 25-34.
2. Bernat, E., Nelson, L., & Baskin-Sommers, A. (2012). Time-frequency theta and delta measures index separable components of feedback processing in a gambling task. Manuscript under review.
3. Bernat, E., Nelson, L., Steele, V., Gehring, W., & Patrick, C. (2011). Externalizing psychopathology and gain-loss feedback in a simulated gambling task: Dissociable components of brain response revealed by time-frequency analysis. Journal of Abnormal Psychology, 120, 352-364.
4. Bogacz, R., McClure, S. M., Li, J., Cohen, J. D., & Montague, P. R. (2007). Short-term memory traces for action bias in human reinforcement learning. Brain Research, 1153, 111-121. doi:10.1016/j.brainres.2007.03.057
5. Bogdan, R., Santesso, D., Fagerness, J., Perlis, R., & Pizzagalli, D. (2011). Corticotropin-releasing hormone receptor type 1 (CRHR1) genetic variation and stress interact to influence reward learning. Journal of Neuroscience, 31, 13246-13254.
6. Carlson, J., Foti, D., Harmon-Jones, E., Mujica-Parodi, L., & Hajcak, G. (2011). The neural processing of rewards in the human striatum: Correlation of fMRI and event-related potentials. Neuro-Image, 57, 1608-1616. doi:10.1016/j.neuroimage.2011.05.037
7. Delgado, M. (2007). Reward-related responses in the human striatum. Annals of the New York Academy of Sciences, 1104, 70-88. doi:10.1196/annals. 1390.002
8. Delgado, M., Nystrom, L., Fissell, C., Noll, D., & Fiez, J. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of Neurophysiology, 84, 3072-3077.
9. Doya, K. (2008). Modulators of decision making. Nature Neuroscience, 11, 410-416. doi:10.1038/nn207
10. Elliott, R., Newman, J. L., Longe, O. A., & Deakin, J. F. (2003). Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: A parametric functional magnetic resonance imaging study. Journal of Neuroscience, 23, 303-307.
11. Foti, D., & Hajcak, G. (2009). Depression and reduced sensitivity to non-rewards versus rewards: Evidence from event-related potentials. Biological Psychology, 81, 1-8. doi:10.1016/j.biopsycho.2008.12.004
12. Foti, D., & Hajcak, G. (2012). Genetic variation in dopamine moderates neural response during reward anticipation and delivery: Evidence from event-related potentials. Psychophysiology, 49, 617-626.
13. Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011). Event-related potential activity in the basal ganglia differentiates rewards from non-rewards: Temporospatial principal components analysis and source localization of the feedback negativity. Human Brain Mapping, 32, 2207-2216. doi:10.1002/hbm.21182
14. Gallistel, C., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289-344. doi:10.1037/033-295X.107.2.289
15. Gehring, W., & Willoughby, A. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279-2282. doi:10.1126/science.1066893
16. Goyer, J. P., Woldorff, M. G., & Huettel, S. A. (2008). Rapid electro-physiological brain responses are influenced by both valence and magnitude of monetary rewards. Journal of Cognitive Neuroscience, 20, 2058-2069. doi:10.1162/jocn.2008.20134
17. Gratton, G., Coles, M. G., & Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55, 468-484.
18. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71, 148-154. doi:10.1016/j.biopsycho.2005.04. 001
19. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44, 905-912. doi:10.1111/j.1469-8986.2007.00567
20. Hewig, J., Kretschmer, N., Trippe, R., Hecht, H., Coles, M., Holroyd, C.,... Miltner, W. (2010). Hypersensitivity to reward in problem gamblers. Biological Psychiatry, 67, 781-783.
21. Holroyd, C., & Coles, M. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the errorrelated negativity. Psychological Review, 109, 679-709. doi:10.1037//0033-295X.109.4.67
22. Holroyd, C., Krigolson, O., & Lee, S. (2011). Reward positivity elicited by predictive cues. NeuroReport, 22, 249-252.
23. Holroyd, C., Nieuwenhuis, S., Yeung, N., & Cohen, J. (2003). Errors in reward prediction are reflected in the event-related brain potential. NeuroReport, 14, 2481-2484. doi:10.1097/01.wnr.0000099601.41403.a
24. Holroyd, C., Pakzad-Vaezi, K., & Krigolson, O. (2008). The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology, 45, 688-697. doi:10.1111/j.1469-8986.2008.00668.x
25. Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000). FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage, 12, 20-27. doi:10.1006/nimg.2000.0593
26. Luu, P., Tucker, D., Derryberry, D., Reed, M., & Poulsen, C. (2003). Electrophysiological responses to errors and feedback in the process of action regulation. Psychological Science, 14, 47-53. doi:10.1111/1467-9280.01417
27. Martin, L., Potts, G., Burton, P., & Montague, P. (2009). Electrophysiological and hemodynamic responses to reward prediction violation. Neuro Report, 20, 1140-1143. doi:10.1097/WNR.0b013e32832f0dca
28. Masaki, H., Shibahara, Y., Ogawa, K., Yamazaki, K., & Hackley, S. (2010). Action-outcome contingency and feedback-related negativity. Psychophysiology, Suppl. 1, S100.
29. McClure, S. M., Berns, G. S., & Montague, P. R. (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron, 38, 339-346. doi:10.1016/S0896-6273(03)00154-5
30. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007). Time discounting for primary rewards. Journal of Neuroscience, 27, 5796-5804.
31. McClure, S. M., Laibson, D. I., Loewenstein, G, & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 503-507.
32. Miltner, W., Braun, C, & Coles, M. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798. doi:10.1162/jocn.1997.9.6.788
33. Montague, P., McClure, S., Baldwin, P., Phillips, P., Budygin, E., Stuber, G,... Wightman, R. (2004). Dynamic gain control of dopamine delivery in freely moving animals. Journal of Neuroscience, 24, 1754-1759. doi: 10.1523/JNEUROSCI.4279-03.2004
34. O'Doherty, J., Dayan, P., Friston, K., Critchley, H., & Dolan, R. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329-337. doi:10.1016/S0896-6273(03)00169-7
35. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454. doi:10.1126/science.1094285
36. Pan, W. X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005). Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network. Journal of Neuroscience, 25, 6235-6242. doi:10.1523/JNEUROSCI.1478-05.2005
37. Roesch, M., Calu, D., & Schoenbaum, G (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nature Neuroscience, 10, 1615-1624. doi:10.1038/nn2013
38. Sato, A., Yasuda, A., Ohira, H., Miyawaki, K., Nishikawa, M., Kumano, H.,... Kuboki, T. (2005). Effects of value and reward magnitude on feedback negativity and P300. NeuroReport, 16, 407-411.
39. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241-263. doi:10.1016/S0896-6273(02)00967-4
40. Schultz, W., Romo, R., Ljungberg, T, Mirenowicz, J., Hollerman, J., & Dickinson, A. (1995). Reward-related signals carried by dopamine neurons. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 233-248). Cambridge: MIT Press.
41. Schultz, W., Tremblay, L., & Hollerman, J. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex, 10, 272-283. doi:10.1093/cercor/10.3.272
42. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction (Vol. 116). Cambridge: Cambridge University Press.
43. Thorndike, E. L. (1927). The law of effect. The American Journal of Psychology, 39, 212-222.
44. Tricomi, E., Delgado, M., & Fiez, J. (2004). Modulation of caudate activity by action contingency. Neuron, 41, 281-292. doi:10.1016/S0896-6273(03) 00848-1
45. Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5, 297-323. doi:10.1007/BF00122574
46. Walsh, M., & Anderson, J. (2011). Learning from delayed feedback: Neural responses in temporal credit assignment. Cognitive, Affective, & Behavioral Neuroscience, 11, 1-13. doi:10.3758/s13415-011-0027-0
47. Yeung, N., Holroyd, C, & Cohen, J. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex, 15, 535-544. doi: 10.1093/cer-cor/bhh153
48. Yeung, N., & Sanfey, A. (2004). Independent coding of reward magnitude and valence in the human brain. Journal of Neuroscience, 24, 6258-6264. doi:10.1523/JNEUROSCI.4537-03.2004