A Neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages

Psychological Bulletin

Volumn 141, Issue 1, 2015, Pages 213-235

  Sambrook, Thomas D ^a   Goslin, Jeremy ^a  

^a UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Event related potential (ERP); Feedback related negativity (FRN); Great grand average; Meta analysis; Reward prediction error (RPE)

Indexed keywords

ADAPTIVE BEHAVIOR; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; HUMAN; META ANALYSIS; PHYSIOLOGY; REWARD; STANDARDS; STATISTICAL ANALYSIS;

DATA INTERPRETATION, STATISTICAL; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK, PSYCHOLOGICAL; HUMANS; REWARD;

EID: 84922964874     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/bul0000006     Document Type: Article

References (119)

1. Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603-617. http://dx.doi .org/10.1348/000712608X377117
2. Balleine, B. W., Daw, N. D., & O'Doherty, J. P. (2008). Multiple forms of value learning and the function of dopamine. Neuroeconomics: Decision Making and the Brain, 2008, 367-385.
3. Banis, S., & Lorist, M. M. (2012). Acute noise stress impairs feedback processing. Biological Psychology, 91, 163-171. http://dx.doi.org/ 10.1016/j.biopsycho.2012.06.009
4. Bartra, O., McGuire, J. T., & Kable, J. W. (2013). The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage, 76, 412-427. http://dx.doi.org/10.1016/j.neuroimage.2013.02.063
5. Bayer, H. M., & Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129- 141. http://dx.doi.org/10.1016/j.neuron.2005.05.020
6. Bellebaum, C., & Daum, I. (2008). Learning-related changes in reward expectancy are reflected in the feedback-related negativity. European Journal of Neuroscience, 27, 1823-1835. http://dx.doi.org/10.1111/j .1460-9568.2008.06138.x
7. Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2010a). It was not MY fault: Event-related brain potentials in active and observational learning from feedback. Cerebral Cortex, 20, 2874-2883. http://dx.doi.org/ 10.1093/cercor/bhq038
8. Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2011). Processing of expected and unexpected monetary performance outcomes in healthy older subjects. Behavioral Neuroscience, 125, 241-251. http://dx.doi .org/10.1037/a0022536
9. Bellebaum, C., Polezzi, D., & Daum, I. (2010b). It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations. Neuropsychologia, 48, 3343-3350. http://dx .doi.org/10.1016/j.neuropsychologia.2010.07.023
10. Bond, C. F., Jr., Wiitala, W. L., & Richard, F. D. (2003). Meta-analysis of raw mean differences. Psychological Methods, 8, 406-418. http://dx.doi .org/10.1037/1082-989X.8.4.406
11. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624-652. http://dx.doi.org/10.1037/0033-295X.108.3.624
12. Bress, J. N., Smith, E., Foti, D., Klein, D. N., & Hajcak, G. (2012). Neural response to reward and depressive symptoms in late childhood to early adolescence. Biological Psychology, 89, 156-162. http://dx.doi.org/ 10.1016/j.biopsycho.2011.10.004
13. Brown, J. W., & Braver, T. S. (2005). Learned predictions of error likelihood in the anterior cingulate cortex. Science, 307, 1118-1121. http://dx.doi.org/10.1126/science.1105783
14. Bunzeck, N., Dayan, P., Dolan, R. J., & Duzel, E. (2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380-1394. http://dx.doi.org/10.1002/hbm.20939
15. Chase, H. W., Swainson, R., Durham, L., Benham, L., & Cools, R. (2011). Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. Journal of Cognitive Neuroscience, 23, 936-946. http://dx.doi.org/10.1162/jocn.2010.21456
16. Chater, N. (2009). Rational and mechanistic perspectives on reinforcement learning. Cognition, 113, 350-364. http://dx.doi.org/10.1016/j.cognition .2008.06.014
17. Cohen, M. X., & Ranganath, C. (2007). Reinforcement learning signals predict future decisions. The Journal of Neuroscience, 27, 371-378. http://dx.doi.org/10.1523/JNEUROSCI.4421-06.2007
18. Diekhof, E. K., Kaps, L., Falkai, P., & Gruber, O. (2012). The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude-an activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing. Neuropsychologia, 50, 1252-1266. http://dx.doi .org/10.1016/j.neuropsychologia.2012.02.007
19. Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods, 1, 170-177. http://dx.doi.org/10.1037/ 1082-989X.1.2.170
20. Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455-463. http://dx.doi.org/10.1111/j.0006-341X.2000 .00455.x
21. Field, A. P., & Gillett, R. (2010). How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology, 63, 665-694. http://dx.doi.org/10.1348/000711010X502733
22. Folstein, J. R., & Van Petten, C. (2008). Influence of cognitive control and mismatch on the N2 component of the ERP: A review. Psychophysiology, 45, 152-170.
23. Foti, D., & Hajcak, G. (2012). Genetic variation in dopamine moderates neural response during reward anticipation and delivery: Evidence from event-related potentials. Psychophysiology, 49, 617-626. http://dx.doi .org/10.1111/j.1469-8986.2011.01343.x
24. Franken, I. H., Van den Berg, I., & Van Strien, J. W. (2010). Individual differences in alcohol drinking frequency are associated with electrophysiological responses to unexpected nonrewards. Alcoholism: Clinical and Experimental Research, 34, 702-707. http://dx.doi.org/10.1111/j .1530-0277.2009.01139.x
25. Friedman, M. (1953). The methodology of positive economics. Essays in Positive Economics, 3-16.
26. Garrison, J., Erdeniz, B., & Done, J. (2013). Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies. Neuroscience and Biobehavioral Reviews, 37, 1297-1310. http://dx.doi.org/10.1016/j .neubiorev.2013.03.023
27. Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279- 2282. http://dx.doi.org/10.1126/science.1066893
28. Glimcher, P. W. (2009). Choice: Towards a standard back-pocket model. San Diego, CA: Elsevier Academic Press.
29. Glimcher, P. W., Camerer, C. F., Fehr, E., & Poldrack, R. A. (2009). Introduction: A brief history of neuroeconomics. San Diego, CA: Elsevier Academic Press.
30. Gu, R., Lei, Z., Broster, L., Wu, T., Jiang, Y., & Luo, Y. J. (2011). Beyond valence and magnitude: A flexible evaluative coding system in the brain. Neuropsychologia, 49, 3891-3897. http://dx.doi.org/10.1016/ j.neuropsychologia.2011.10.006
31. Hajcak, G., Holroyd, C. B., Moser, J. S., & Simons, R. F. (2005). Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology, 42, 161-170. http://dx.doi.org/10.1111/j .1469-8986.2005.00278.x
32. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71, 148-154. http://dx.doi.org/ 10.1016/j.biopsycho.2005.04.001
33. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44, 905-912. http://dx .doi.org/10.1111/j.1469-8986.2007.00567.x
34. HajiHosseini, A., Rodríguez-Fornells, A., & Marco-Pallarés, J. (2012). The role of beta-gamma oscillations in unexpected rewards processing. NeuroImage, 60, 1678-1685. http://dx.doi.org/10.1016/j.neuroimage .2012.01.125
35. Hauser, T. U., Iannaccone, R., Stämpfli, P., Drechsler, R., Brandeis, D., Walitza, S., & Brem, S. (2014). The feedback-related negativity (FRN) revisited: New insights into the localization, meaning and network organization. NeuroImage, 84, 159 -168. http://dx.doi.org/10.1016/j .neuroimage.2013.08.028
36. Hewig, J., Kretschmer, N., Trippe, R. H., Hecht, H., Coles, M. G., Holroyd, C. B., & Miltner, W. H. (2010). Hypersensitivity to reward in problem gamblers. Biological Psychiatry, 67, 781-783. http://dx.doi.org/ 10.1016/j.biopsych.2009.11.009
37. Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679 -709. http://dx.doi.org/ 10.1037/0033-295X.109.4.679
38. Holroyd, C. B., Krigolson, O. E., Baker, R., Lee, S., & Gibson, J. (2009). When is an error not a prediction error? An electrophysiological investigation. Cognitive, Affective & Behavioral Neuroscience, 9, 59-70. http://dx.doi.org/10.3758/CABN.9.1.59
39. Holroyd, C. B., Krigolson, O. E., & Lee, S. (2011). Reward positivity elicited by predictive cues. NeuroReport, 22, 249-252. http://dx.doi.org/ 10.1097/WNR.0b013e328345441d
40. Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. NeuroReport, 14, 2481-2484. http://dx.doi.org/10.1097/ 00001756-200312190-00037
41. Holroyd, C. B., Pakzad-Vaezi, K. L., & Krigolson, O. E. (2008). The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology, 45, 688- 697. http://dx.doi.org/10.1111/j.1469-8986.2008.00668.x
42. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings. Atlanta, GA: Sage.
43. Ichikawa, N., Siegle, G. J., Dombrovski, A., & Ohira, H. (2010). Subjective and model-estimated reward prediction: Association with the feedback-related negativity (FRN) and reward prediction error in a reinforcement learning task. International Journal of Psychophysiology, 78, 273-283. http://dx.doi.org/10.1016/j.ijpsycho.2010.09.001
44. Kahneman, D. (2003). Maps of bounded rationality: Psychology for behavioral economics. The American Economic Review, 93, 1449-1475. http://dx.doi.org/10.1257/000282803322655392
45. Kamarajan, C., Porjesz, B., Rangaswamy, M., Tang, Y., Chorlian, D. B., Padmanabhapillai, A. Begleiter, H. (2009). Brain signatures of monetary loss and gain: Outcome-related potentials in a single outcome gambling task. Behavioural Brain Research, 197, 62-76. http://dx.doi .org/10.1016/j.bbr.2008.08.011
46. Kreussel, L., Hewig, J., Kretschmer, N., Hecht, H., Coles, M. G. H., & Miltner, W. H. R. (2012). The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. Psychophysiology, 49, 207-219. http://dx.doi.org/ 10.1111/j.1469-8986.2011.01291.x
47. Kujawa, A., Smith, E., Luhmann, C., & Hajcak, G. (2013). The feedback negativity reflects favorable compared to nonfavorable outcomes based on global, not local, alternatives. Psychophysiology, 50, 134-138. http:// dx.doi.org/10.1111/psyp.12002
48. Langer, E. J. (1975). The illusion of control. Journal of Personality and Social Psychology, 32, 311-328. http://dx.doi.org/10.1037/0022-3514 .32.2.311
49. Larson, M. J., Kelly, K. G., Stigge-Kaufman, D. A., Schmalfuss, I. M., & Perlstein, W. M. (2007). Reward context sensitivity impairment following severe TBI: An event-related potential investigation. Journal of the International Neuropsychological Society, 13, 615-625. http://dx.doi .org/10.1017/S1355617707070762
50. Li, P., Han, C., Lei, Y., Holroyd, C. B., & Li, H. (2011). Responsibility modulates neural mechanisms of outcome processing: An ERP study. Psychophysiology, 48, 1129 -1133. http://dx.doi.org/10.1111/j.1469- 8986.2011.01182.x
51. Liao, Y., Gramann, K., Feng, W., Deák, G. O., & Li, H. (2011). This ought to be good: Brain activity accompanying positive and negative expectations and outcomes. Psychophysiology, 48, 1412-1419. http://dx .doi.org/10.1111/j.1469-8986.2011.01205.x
52. Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011). Common and distinct networks underlying reward valence and processing stages: A metaanalysis of functional neuroimaging studies. Neuroscience and Biobehavioral Reviews, 35, 1219-1236. http://dx.doi.org/10.1016/j.neubiorev .2010.12.012
53. Luck, S. J. (2005). An introduction to the event-related potential technique. Cambridge, MA: MIT Press.
54. Luo, Q., & Qu, C. (2013). Comparison enhances size sensitivity: Neural correlates of outcome magnitude processing. PLoS ONE, 8, e71186. http://dx.doi.org/10.1371/journal.pone.0071186
55. Luu, P., Tucker, D. M., Derryberry, D., Reed, M., & Poulsen, C. (2003). Electrophysiological responses to errors and feedback in the process of action regulation. Psychological Science, 14, 47-53. http://dx.doi.org/ 10.1111/1467-9280.01417
56. Marco-Pallarés, J., Cucurell, D., Cunillera, T., Krämer, U. M., Camara, E., Nager, W. Rodriguez-Fornells, A. (2009). Genetic variability in the dopamine system (dopamine receptor D4, catechol-Omethyltransferase) modulates neurophysiological responses to gains and losses. Biological Psychiatry, 66, 154 -161. http://dx.doi.org/ 10.1016/j.biopsych.2009.01.006
57. Maris, E., & Oostenveld, R. (2007). Nonparametric statistical testing of EEG- and MEG-data. Journal of Neuroscience Methods, 164, 177-190. http://dx.doi.org/10.1016/j.jneumeth.2007.03.024
58. Mars, R. B., De Bruijn, E. R., Hulstijn, W., Miltner, W. H., & Coles, M. G. (2004). What if I told you: "You were wrong"? Brain potentials and behavioral adjustments elicited by feedback in a time-estimation task. In M. Ullsperger & M. Falkenstein (Eds.), Errors, conflicts, and the brain. Current opinions on performance monitoring (pp. 129-134). Leipzig, Germany: MPI of Cognitive Neuroscience.
59. Mas-Herrero, E., & Marco-Pallarés, J. (2014). Frontal theta oscillatory activity is a common mechanism for the computation of unexpected outcomes and learning rate. Journal of Cognitive Neuroscience, 26, 447-458. http://dx.doi.org/10.1162/jocn_a_00516
60. Mason, L., O'Sullivan, N., Bentall, R. P., & El-Deredy, W. (2012). Better than I thought: Positive evaluation bias in hypomania. PLoS ONE, 7, e47754. http://dx.doi.org/10.1371/journal.pone.0047754
61. Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788 -798. http://dx.doi.org/10.1162/jocn .1997.9.6.788
62. Morris, S. E., Holroyd, C. B., Mann-Wrobel, M. C., & Gold, J. M. (2011). Dissociation of response and feedback negativity in schizophrenia: Electrophysiological and computational evidence for a deficit in the representation of value. Frontiers in Human Neuroscience, 5, 123. http://dx .doi.org/10.3389/fnhum.2011.00123
63. Moser, J. S., & Simons, R. F. (2009). The neural consequences of flipflopping: The feedback-related negativity and salience of reward prediction. Psychophysiology, 46, 313-320. http://dx.doi.org/10.1111/j .1469-8986.2008.00760.x
64. Mushtaq, F., Stoet, G., Bland, A. R., & Schaefer, A. (2013). Relative changes from prior reward contingencies can constrain brain correlates of outcome monitoring. PLoS ONE, 8, e66350. http://dx.doi.org/ 10.1371/journal.pone.0066350
65. Mushtaq, F. M. W. R., Mon-Williams, M., & Schaefer, A. (2014). Unpublished data, University of Leeds and Monash University.
66. Nieuwenhuis, S., Yeung, N., van den Wildenberg, W., & Ridderinkhof, K. R. (2003). Electrophysiological correlates of anterior cingulate function in a go/no-go task: Effects of response conflict and trial type frequency. Cognitive, Affective & Behavioral Neuroscience, 3, 17-26. http://dx.doi.org/10.3758/CABN.3.1.17
67. Nittono, H., Otsuka, Y., & Ullsperger, P. (2008). Asymmetrical effects of frequent gains and frequent losses in a gambling task. NeuroReport, 19, 1345-1349. http://dx.doi.org/10.1097/WNR.0b013e32830c21a8
68. Oliveira, F. T. P., McDonald, J. J., & Goodman, D. (2007). Performance monitoring in the anterior cingulate is not all error related: Expectancy deviation and the representation of action-outcome associations. Journal of Cognitive Neuroscience, 19, 1994-2004. http://dx.doi.org/10.1162/ jocn.2007.19.12.1994
69. Onoda, K., Abe, S., & Yamaguchi, S. (2010). Feedback-related negativity is correlated with unplanned impulsivity. NeuroReport, 21, 736-739.
70. Pedroni, A., Langer, N., Koenig, T., Allemand, M., & Jäncke, L. (2011). Electroencephalographic topography measures of experienced utility. The Journal of Neuroscience, 31, 10474 -10480. http://dx.doi.org/ 10.1523/JNEUROSCI.5488-10.2011
71. Pfabigan, D. M., Alexopoulos, J., Bauer, H., & Sailer, U. (2011). Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in event-related brain potentials. Psychophysiology, 48, 656-664. http://dx.doi.org/10.1111/j .1469-8986.2010.01136.x
72. Philiastides, M. G., Biele, G., Vavatzanidis, N., Kazzer, P., & Heekeren, H. R. (2010). Temporal dynamics of prediction error processing during reward-based decision making. NeuroImage, 53, 221-232. http://dx.doi .org/10.1016/j.neuroimage.2010.05.052
73. Platt, M. L., & Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400, 233-238. http://dx.doi.org/ 10.1038/22268
74. Roberts, K., Infantolino, Z., Stanley, E. M., & Simons, R. F. (2013). Unpublished data, University of Delaware.
75. Rosenthal, R. (1991). Meta-analytic procedures for social research (rev. ed.). Thousand Oaks, CA: Sage. http://dx.doi.org/10.4135/ 9781412984997
76. Sambrook, T. D., & Goslin, J. (2014). Mediofrontal event-related potentials in response to positive, negative and unsigned prediction errors. Neuropsychologia, 61, 1-10. http://dx.doi.org/10.1016/j.neuropsychologia. 2014.06.004
77. Sambrook, T. D., & Goslin, J. (2013). Unpublished data Experiment 1, University of Plymouth.
78. Sambrook, T. D., & Goslin, J. (2014). Unpublished data Experiment 2, University of Plymouth.
79. Sambrook, T. D., & Goslin, J. (2013). Unpublished data Experiment 3, University of Plymouth.
80. Sambrook, T. D., Roser, M., & Goslin, J. (2012). Prospect theory does not describe the feedback-related negativity value function. Psychophysiology, 49, 1533-1544. http://dx.doi.org/10.1111/j.1469-8986.2012 .01482.x
81. Samuelson, P. A. (1937). A note on measurement of utility. The Review of Economic Studies, 4, 155-161. http://dx.doi.org/10.2307/2967612
82. San Martín, R. (2012). Event-related potential studies of outcome processing and feedback-guided learning. Frontiers in Human Neuroscience, 6, 304. http://dx.doi.org/10.3389/fnhum.2012.00304
83. San Martín, R., Appelbaum, L. G., Pearson, J. M., Huettel, S. A., & Woldorff, M. G. (2013). Rapid brain responses independently predict gain maximization and loss minimization during economic decision making. The Journal of Neuroscience, 33, 7011-7019. http://dx.doi.org/ 10.1523/JNEUROSCI.4242-12.2013
84. San Martín, R., Manes, F., Hurtado, E., Isla, P., & Ibañez, A. (2010). Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. NeuroImage, 51, 1194-1204. http://dx.doi.org/10.1016/j .neuroimage.2010.03.031
85. Santesso, D. L., Dzyundzyak, A., & Segalowitz, S. J. (2011). Age, sex and individual differences in punishment sensitivity: Factors influencing the feedback-related negativity. Psychophysiology, 48, 1481-1489. http://dx.doi.org/10.1111/j.1469-8986.2011.01229.x
86. Sato, A., Yasuda, A., Ohira, H., Miyawaki, K., Nishikawa, M., Kumano, H., & Kuboki, T. (2005). Effects of value and reward magnitude on feedback negativity and P300. NeuroReport, 16, 407-411. http://dx.doi .org/10.1097/00001756-200503150-00020
87. Schuermann, B., Endrass, T., & Kathmann, N. (2012). Neural correlates of feedback processing in decision-making under risk. Frontiers in Human Neuroscience, 6, 204. http://dx.doi.org/10.3389/fnhum.2012 .00204
88. Schultz, W. (2009). Midbrain dopamine neurons: A retina of the reward system. In P. W. Glimcher, C. F. Camerer, E. Fehr, & R. A. Poldrack (Eds.), Neuroeconomics: Decision making and the brain (pp. 321-328). London, UK: Academic Press.
89. Schultz, W. (2010). Dopamine signals for reward value and risk: Basic and recent data. Behavioral and Brain Functions, 6, 24. http://dx.doi.org/ 10.1186/1744-9081-6-24
90. Sutton, R. S., & Barto, A. G. (1998). Introduction to reinforcement learning. Cambridge, MA: MIT Press.
91. Talmi, D., Atkinson, R., & El-Deredy, W. (2013). The feedback-related negativity signals salience prediction errors, not reward prediction errors. The Journal of Neuroscience, 33, 8264-8269. http://dx.doi.org/ 10.1523/JNEUROSCI.5695-12.2013
92. Talmi, D., Fuentemilla, L., Litvak, V., Duzel, E., & Dolan, R. J. (2012). An MEG signature corresponding to an axiomatic model of reward prediction error. NeuroImage, 59, 635- 645. http://dx.doi.org/10.1016/j .neuroimage.2011.06.051
93. Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005). Adaptive coding of reward value by dopamine neurons. Science, 307, 1642-1645. http://dx .doi.org/10.1126/science.1105370
94. Toyomaki, A., & Murohashi, H. (2005). Discrepancy between feedback negativity and subjective evaluation in gambling. NeuroReport, 16, 1865-1868. http://dx.doi.org/10.1097/01.wnr.0000185962.96217.36
95. Tversky, A., & Kahneman, D. (1992). Advances in prospect-theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5, 297-323. http://dx.doi.org/10.1007/BF00122574
96. Van den Berg, I., Franken, I. H. A., & Muris, P. (2011). Individual differences in sensitivity to reward association with electrophysiological responses to monetary gains and losses. Journal of Psychophysiology, 25, 81-86. http://dx.doi.org/10.1027/0269-8803/a000032
97. van der Helden, J., Boksem, M. A. S., & Blom, J. H. G. (2010). The importance of failure: Feedback-related negativity predicts motor learning efficiency. Cerebral Cortex, 20, 1596 -1603. http://dx.doi.org/ 10.1093/cercor/bhp224
98. Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36, 1-48.
99. Walsh, M. M., & Anderson, J. R. (2011a). Learning from delayed feedback: Neural responses in temporal credit assignment. Cognitive, Affective & Behavioral Neuroscience, 11, 131-143. http://dx.doi.org/ 10.3758/s13415-011-0027-0
100. Walsh, M. M., & Anderson, J. R. (2011b). Modulation of the feedbackrelated negativity by instruction and experience. Proceedings of the National Academy of Sciences of the United States of America, 108, 19048-19053. http://dx.doi.org/10.1073/pnas.1117189108
101. Walsh, M. M., & Anderson, J. R. (2012). Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neuroscience and Biobehavioral Reviews, 36, 1870-1884. http://dx.doi.org/10.1016/j.neubiorev.2012.05.008
102. Walsh, M. M., & Anderson, J. R. (2013). Electrophysiological responses to feedback during the application of abstract rules. Journal of Cognitive Neuroscience, 25, 1986-2002. http://dx.doi.org/10.1162/jocn_a_00454
103. Walsh, M. M., & Anderson, J. R. (2014). Navigating complex decision spaces: Problems and paradigms in sequential choice. Psychological Bulletin, 140, 466-486. http://dx.doi.org/10.1037/a0033455
104. Walsh, M. M., & Anderson, J. (2011). Unpublished data Experiment 1, Carnegie Mellon University.
105. Walsh, M. M., & Anderson, J. (2011). Unpublished data Experiment 2, Carnegie Mellon University.
106. Warren, C. M., & Holroyd, C. B. (2012). The impact of deliberative strategy dissociates ERP components related to conflict processing vs. reinforcement learning. Frontiers in Neuroscience, 6, 43. http://dx.doi .org/10.3389/fnins.2012.00043
107. Wu, Y., & Zhou, X. (2009). The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Research, 1286, 114-122. http://dx.doi.org/10.1016/j.brainres.2009.06.032
108. Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012). Dopamine enhances model-based over model-free choice behavior. Neuron, 75, 418-424. http://dx.doi.org/10.1016/j.neuron.2012.03.042
109. Yang, Q., Gu, R., Tang, P., & Luo, Y. J. (2013). How does cognitive reappraisal affect the response to gains and losses? Psychophysiology, 50, 1094-1103. http://dx.doi.org/10.1111/psyp.12091
110. Yasuda, A., Sato, A., Miyawaki, K., Kumano, H., & Kuboki, T. (2004). Error-related negativity reflects detection of negative reward prediction error. NeuroReport, 15, 2561-2565. http://dx.doi.org/10.1097/ 00001756-200411150-00027
111. Yeung, N., Botvinick, M. M., & Cohen, J. D. (2004). The neural basis of error detection: Conflict monitoring and the error-related negativity. Psychological Review, 111, 931-959. http://dx.doi.org/10.1037/0033- 295X.111.4.931
112. Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex, 15, 535-544.
113. Yeung, N., & Sanfey, A. G. (2004). Independent coding of reward magnitude and valence in the human brain. The Journal of Neuroscience, 24, 6258-6264. http://dx.doi.org/10.1523/JNEUROSCI.4537-03 .2004
114. Yi, F., Chen, H., Wang, X., Shi, H., Yi, J., Zhu, X., & Yao, S. (2012). Amplitude and latency of feedback-related negativity: Aging and sex differences. NeuroReport, 23, 963-969. http://dx.doi.org/10.1097/WNR .0b013e328359d1c4
115. Yu, R., & Zhang, P. (2014). Neural evidence for description dependent reward processing in the framing effect. Frontiers in Neuroscience, 8, 56. http://dx.doi.org/10.3389/fnins.2014.00056
116. Yu, R., Zhou, W., & Zhou, X. (2011). Rapid processing of both reward probability and reward uncertainty in the human anterior cingulate cortex. PLoS ONE, 6, e29633. http://dx.doi.org/10.1371/journal.pone .0029633
117. Yu, R., & Zhou, X. (2006). Brain responses to outcomes of one's own and other's performance in a gambling task. NeuroReport, 17, 1747-1751. http://dx.doi.org/10.1097/01.wnr.0000239960.98813.50
118. Yu, R., & Zhou, X. (2009). To bet or not to bet? The error negativity or error-related negativity associated with risk-taking choices. Journal of Cognitive Neuroscience, 21, 684-696. http://dx.doi.org/10.1162/jocn .2009.21034
119. Zottoli, T. M., & Grose-Fifer, J. (2012). The feedback-related negativity (FRN) in adolescents. Psychophysiology, 49, 413-420. http://dx.doi.org/ 10.1111/j.1469-8986.2011.01312.x