The feedback-related negativity reflects "more or less" prediction error in appetitive and aversive conditions

Frontiers in Neuroscience

Volumn , Issue 8 MAY, 2014, Pages

  Huang, Yi ^a   Yu, Rongjun ^a  

^a SOUTH CHINA NORMAL UNIVERSITY   (China)

Author keywords

Appetitive; Aversive; Erp; Feedback related negative; Reinforcement learning

Indexed keywords

ADULT; APPETITE; ARTICLE; ASSOCIATION; AVERSIVE BEHAVIOR; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; FEEDBACK RELATED NEGATIVITY; FEEDBACK SYSTEM; FEMALE; HUMAN; MALE; NORMAL HUMAN; PREDICTION; REWARD; TASK PERFORMANCE;

EID: 84905027368     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2014.00108     Document Type: Article

References (33)

1. Boksem, M. A., and De Cremer, D. (2010). Fairness concerns predict medial frontal negativity amplitude in ultimatum bargaining. Soc. Neurosci. 5, 118-128. doi: 10.1080/17470910903202666
2. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834. doi: 10.1016/j.neuron.2010.11.022
3. Chase, H. W., Swainson, R., Durham, L., Benham, L., and Cools, R. (2011). Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. J. Cogn. Neurosci. 23, 936-946. doi: 10.1162/jocn.2010.21456
4. Cohen, M. X., Elger, C. E., and Ranganath, C. (2007). Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage 35, 968-978. doi: 10.1016/j.neuroimage.2006.11.056
5. Esber, G. R., and Haselgrove, M. (2011). Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning. Proc. Biol. Sci. 278, 2553-2561. doi: 10.1098/rspb.2011.0836
6. Falkenstein, M., Hohnsbein, J., Hoormann, J., and Blanke, L. (1991). Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. Electroencephalogr. Clin. Neurophysiol. 78, 447-455. doi: 10.1016/0013-4694(91)90062-9
7. Gehring, W. J., and Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295, 2279-2282. doi: 10.1126/science.1066893
8. Gratton, G., Coles, M. G. H., and Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalogr. Clin. Neurophysiol. 55, 468-484. doi: 10.1016/0013-4694(83)90135-9
9. Hajcak, G., Holroyd, C. B., Moser, J. S., and Simons, R. F. (2005). Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology 42, 161-170. doi: 10.1111/j.1469-8986.2005.00278.x
10. Hajcak, G., Moser, J. S., Holroyd, C. B., and Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biol. Psychol. 71, 148-154. doi: 10.1016/j.biopsycho.2005.04.001
11. Hajcak, G., Moser, J. S., Holroyd, C. B., and Simons, R. F. (2007). It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology 44, 905-912. doi: 10.1111/j.1469-8986.2007.00567.x
12. Hauser, T. U., Iannaccone, R., Stämpfli, P., Drechsler, R., Brandeis, D., Walitza, S., et al. (2014). The feedback-related negativity (FRN) revisited: new insights into the localization, meaning and network organization. Neuroimage 84, 159-168. doi: 10.1016/j.neuroimage.2013.08.028
13. Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., and Platt, M. L. (2011). Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J. Neurosci. 31, 4178-4187. doi: 10.1523/JNEUROSCI.4652-10.2011
14. Holroyd, C. B., and Coles, M. G. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709. doi: 10.1037//0033-295X.109.4.679
15. Holroyd, C. B., Hajcak, G., and Larsen, J. T. (2006). The good, the bad and the neutral: electrophysiological responses to feedback stimuli. Brain Res. 1105, 93-101. doi: 10.1016/j.brainres.2005.12.015
16. Holroyd, C. B., Larsen, J. T., and Cohen, J. D. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology 41, 245-253. doi: 10.1111/j.1469-8986.2004.00152.x
17. Holroyd, C. B., Nieuwenhuis, S., Yeung, N., and Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. Neuroreport 14, 2481-2484. doi: 10.1097/01.wnr.0000099601.41403.a5
18. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841. doi: 10.1038/nature08028
19. Miltner, W. H. R., Braun, C. H., and Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: evidence for a "generic" neural system for error detection. J. Cogn. Neurosci. 9, 788-798. doi: 10.1162/jocn.1997.9.6.788
20. Nieuwenhuis, S., Holroyd, C. B., Mol, N., and Coles, M. G. (2004). Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci. Biobehav. Rev. 28, 441-448. doi: 10.1016/j.neubiorev.2004.05.003
21. Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97-113. doi: 10.1016/0028-3932(71)90067-4
22. Oliveira, F. T., McDonald, J. J., and Goodman, D. (2007). Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J. Cogn. Neurosci. 19, 1994-2004. doi: 10.1162/jocn.2007.19.12.1994
23. Pearce, J. M., and Hall, G. (1980). A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532. doi: 10.1037//0033-295X.87.6.532
24. Pernet, C. R., Sajda, P., and Rousselet, G. A. (2011). Single-trial analyses: why bother? Front. Psychol. 2:322. doi: 10.3389/fpsyg.2011.00322
25. Pfabigan, D. M., Alexopoulos, J., Bauer, H., and Sailer, U. (2011). Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in event-related brain potentials. Psychophysiology 48, 656-664. doi: 10.1111/j.1469-8986.2010.01136.x
26. Polezzi, D., Daum, I., Rubaltelli, E., Lotto, L., Civai, C., Sartori, G., et al. (2008). Mentalizing in economic decision-making. Behav. Brain Res. 190, 218-223. doi: 10.1016/j.bbr.2008.03.003
27. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nat. Rev. Neurosci. 7, 967-975. doi: 10.1038/nrn2022
28. Roesch, M. R., Calu, D. J., Esber, G. R., and Schoenbaum, G. (2010). All that glitters... dissociating attention and outcome expectancy from prediction errors signals. J. Neurophysiol. 104, 587-595. doi: 10.1152/jn.00173.2010
29. Seymour, B., Daw, N., Dayan, P., Singer, T., and Dolan, R. (2007). Differential encoding of losses and gains in the human striatum. J. Neurosci. 27, 4826-4831. doi: 10.1523/JNEUROSCI.0400-07.2007
30. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
31. Talmi, D., Atkinson, R., and El-Deredy, W. (2013). The feedback-related negativity signals salience prediction errors, not reward prediction errors. J. Neurosci. 33, 8264-8269. doi: 10.1523/JNEUROSCI.5695-12.2013
32. Walsh, M. M., and Anderson, J. R. (2011). Modulation of the feedback-related negativity by instruction and experience. Proc. Natl. Acad. Sci. U.S.A. 108, 19048-19053. doi: 10.1073/pnas.1117189108
33. Yu, R., and Zhou, X. (2006). Brain potentials associated with outcome expectation and outcome evaluation. Neuroreport 17, 1649. doi: 10.1097/01.wnr.0000236866.39328.1d