Prospect theory does not describe the feedback-related negativity value function

Psychophysiology

Volumn 49, Issue 12, 2012, Pages 1533-1544

  Sambrook, Thomas D ^a   Roser, Matthew ^a   Goslin, Jeremy ^a  

^a UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Dopamine; ERP; Feedback negativity; FRN; P300; Prospect theory

Indexed keywords

EID: 84868196658     PISSN: 00485772     EISSN: 14698986     Source Type: Journal    
DOI: 10.1111/j.1469-8986.2012.01482.x     Document Type: Article

References (62)

1. Bayer, H. M., & Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141. doi: 10.1016/j.neuron.2005.05.020
2. Bayer, H. M., Lau, B., & Glimcher, P. W. (2007). Statistics of midbrain dopamine neuron spike trains in the awake primate. Journal of Neurophysiology, 98, 1428-1439. doi: 10.1152/jn.01140.2006
3. Bellebaum, C., & Daum, I. (2008). Learning-related changes in reward expectancy are reflected in the feedback-related negativity. European Journal of Neuroscience, 27, 1823-1835. doi: 10.1111/j.1460-9568.2008.06138.x
4. Bellebaum, C., Polezzi, D., & Daum, I. (2010). It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations. Neuropsychologia, 48, 3343-3350. doi: 10.1016/j.neuropsychologia.2010.07.023
5. Brown, P., & Molliver, M. E. (2000). Dual serotonin (5-HT) projections to the nucleus accumbens core and shell: Relation of the 5-HT transporter to amphetamine-induced neurotoxicity. Journal of Neuroscience, 20, 1952-1963.
6. Brunia, C. H. M., & van Boxtel, G. J. M. (2012). Negative slow waves as indices of anticipation: The bereitschaftspotential, the contingent negative variation, and the stimulus preceding negativity. In S. J. Luck & E. S. Kappenman (Eds.), Oxford handbook of event-related potential components. New York, NY: Oxford University Press.
7. Campbell-Meiklejohn, D., Wakeley, J., Herbert, V., Cook, J., Scollo, P., Ray, M. K., ... Rogers, R. D. (2011). Serotonin and dopamine play complementary roles in gambling to recover losses. Neuropsychopharmacology, 36, 402-410. doi: 10.1038/Npp.2010.170
8. Carlson, J. M., Foti, D., Mujica-Parodi, L. R., Harmon-Jones, E., & Hajcak, G. (2011). Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study. Neuroimage, 57, 1608-1616. doi: 10.1016/j.neuroimage.2011.05.037
9. Chen, M. K., Lakshminarayanan, V., & Santos, L. R. (2006). How basic are behavioral biases? Evidence from capuchin monkey trading behavior. Journal of Political Economy, 114, 517-537.
10. Cohen, M. X., Cavanagh, J. F., & Slagter, H. A. (2011). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity: Commentary. Human Brain Mapping, 32, 2270-2271. doi: 10.1002/Hbm.21358
11. Crowley, M. J., Wu, J., Bailey, C. A., & Mayes, L. C. (2009). Bringing in the negative reinforcements: The avoidance feedback-related negativity. Neuroreport, 20, 1513-1517. doi: 10.1097/Wnr.0b013e32832ff2f5
12. Daw, N. D., Kakade, S., & Dayan, P. (2002). Opponent interactions between serotonin and dopamine. Neural Networks, 15, 603-616.
13. de Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009). The neurobiology of reference-dependent value computation. Journal of Neuroscience, 29, 3833-3842. doi: 10.1523/Jneurosci.4832-08.2009
14. de Martino, B., Kumaran, D., Seymour, B., & Dolan, R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science, 313, 684-687. doi: 10.1126/science.1128356
15. Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011a). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Response to Commentary. Human Brain Mapping, 32, 2267-2269. doi: 10.1002/Hbm.21357
16. Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011b). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity. Human Brain Mapping, 32, 2207-2216. doi: 10.1002/Hbm.21182
17. Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279-2282.
18. Gu, R. L., Lei, Z. H., Broster, L., Wu, T. T., Jiang, Y., & Luo, Y. J. (2011). Beyond valence and magnitude: A flexible evaluative coding system in the brain. Neuropsychologia, 49, 3891-3897. doi: 10.1016/j.neuropsychologia.2011.10.006
19. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71, 148-154. doi: 10.1016/j.biopsycho.2005.04.001
20. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44, 905-912. doi: 10.1111/j.1469-8986.2007.00567.x
21. Heidbreder, C. A., Hedou, G., & Feldon, J. (1999). Behavioral neurochemistry reveals a new functional dichotomy in the shell subregion of the nucleus accumbens. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 23, 99-132.
22. Hollerman, J. R., & Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience, 1, 304-309.
23. Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709. doi: 10.1037//0033-295x.109.4.679
24. Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology, 41, 245-253. doi: 10.1111/j.1469-8986.2004.00152.x
25. Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. Neuroreport, 14, 2481-2484. doi: 10.1097/01.wnr.0000099601/41403.a5
26. Kahneman, D., & Tversky, A. (1979). Prospect theory-Analysis of decision under risk. Econometrica, 47, 263-291.
27. Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. Journal of Neuroscience, 21, article RC159.
28. Knutson, B., Wimmer, G. E., Rick, S., Hollon, N. G., Prelec, D., & Loewenstein, G. (2008). Neural antecedents of the endowment effect. Neuron, 58, 814-822. doi: 10.1016/j.neuron.2008.05.018
29. Kotani, Y., Kishida, S., Hiraku, S., Suda, K., Ishii, M., & Aihara, Y. (2003). Effects of information and reward on stimulus-preceding negativity prior to feedback stimuli. Psychophysiology, 40, 818-826.
30. Kreussel, L., Hewig, J., Kretschmer, N., Hecht, H., Coles, M. G. H., & Miltner, W. H. R. (2012). The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. Psychophysiology, 49, 207-219. doi: 10.1111/j.1469-8986.2011.01291.x
31. Lakshminarayanan, V. R., Chen, M. K., & Santos, L. R. (2011). The evolution of decision-making under risk: Framing effects in monkey risk preferences. Journal of Experimental Social Psychology, 47, 689-693. doi: 10.1016/j.jesp.2010.12.011
32. Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011). Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies. Neuroscience and Biobehavioral Reviews, 35, 1219-1236. doi: 10.1016/j.neubiorev.2010.12.012
33. Luu, P., Tucker, D. M., Derryberry, D., Reed, M. & Poulsen, C. (2003). Electrophysiological responses to errors and feedback in the process of action regulation. Psychological Science, 14, 47-53. doi: 10.1111/1467-9280.01417
34. Marco-Pallares, J., Cucurell, D., Munte, T. F., Strien, N., & Rodriguez-Fornells, A. (2011). On the number of trials needed for a stable feedback-related negativity. Psychophysiology, 48, 852-860. doi: 10.1111/j.1469-8986.2010.01152.x
35. Marco-Pallares, J., Kramer, U. M., Strehl, S., Schroder, A., & Munte, T. F. (2010). When decisions of others matter to me: An electrophysiological analysis. BMC Neuroscience, 11, article 86. doi: 10.1186/1471-2202-11-86
36. Marsh, B., & Kacelnik, A. (2002). Framing effects and risky decisions in starlings. Proceedings of the National Academy of Sciences of the United States of America, 99, 3352-3355. doi: 10.1073/pnas.042491999
37. Martin, L. E., Potts, G. F., Burton, P. C., & Montague, P. R. (2009). Electrophysiological and hemodynamic responses to reward prediction violation. Neuroreport, 20, 1140-1143. doi: 10.1097/Wnr.0b013e32832f0dca
38. Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004). Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron, 43, 133-143.
39. Moser, J. S., & Simons, R. F. (2009). The neural consequences of flip-flopping: The feedback-related negativity and salience of reward prediction. Psychophysiology, 46, 313-320. doi: 10.1111/j.1469-8986.2008.00760.x
40. Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005). Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychological Bulletin, 131, 510-532. doi: 10.1037/0033-2909.131.4.510
41. Oliveira, F. T. P., McDonald, J. J., & Goodman, D. (2007). Performance monitoring in the anterior cingulate is not all error related: Expectancy deviation and the representation of action-outcome associations. Journal of Cognitive Neuroscience, 19, 1994-2004.
42. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature, 442, 1042-1045. doi: 10.1038/Nature05051
43. Pine, A., Seymour, B., Roiser, J. P., Bossaerts, P., Friston, K. J., Curran, H. V., & Dolan, R. J. (2009). Encoding of marginal utility across time in the human brain. Journal of Neuroscience, 29, 9575-9581. doi: 10.1523/Jneurosci.1126-09.2009
44. Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006). When things are better or worse than expected: The medial frontal cortex and the allocation of processing resources. Journal of Cognitive Neuroscience, 18, 1112-1119.
45. San Martin, R., Manes, F., Hurtado, E., Isla, P., & Ibanez, A. (2010). Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. Neuroimage, 51, 1194-1204. doi: 10.1016/j.neuroimage.2010.03.031
46. Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003). Correlated coding of motivation and outcome of decision by dopamine neurons. Journal of Neuroscience, 23, 9913-9923.
47. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
48. Seymour, B., Daw, N., Dayan, P., Singer, T., & Dolan, R. (2007). Differential encoding of losses and gains in the human striatum. Journal of Neuroscience, 27, 4826-4831. doi: 10.1523/Jneurosci.0400-07.2007
49. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
50. Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007). The neural basis of loss aversion in decision-making under risk. Science, 315, 515-518. doi: 10.1126/science.1134239
51. Toyomaki, A., & Murohashi, H. (2005). Discrepancy between feedback negativity and subjective evaluation in gambling. Neuroreport, 16, 1865-1868.
52. Trepel, C., Fox, C. R., & Poldrack, R. A. (2005). Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. Cognitive Brain Research, 23, 34-50. doi: 10.1016/j.cogbrainres.2005.01.016
53. Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211, 453-458.
54. Tversky, A., & Kahneman, D. (1992). Advances in prospect-theory-Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5, 297-323.
55. van Boxtel, G. J. M., & Bocker, K. B. E. (2004). Cortical measures of anticipation. Journal of Psychophysiology, 18, 61-76. doi: 10.1027/0269-8803.18.2-3.61
56. von Neumann, J., & Morgenstern, O. (1944). Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
57. Weber, B., Aholt, A., Neuhaus, C., Trautner, P., Elger, C. E., & Teichert, T. (2007). Neural evidence for reference-dependence in real-market-transactions. Neuroimage, 35, 441-447. doi: 10.1016/j.neuroimage.2006.11.034
58. Wu, Y., & Zhou, X. L. (2009). The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Research, 1286, 114-122. doi: 10.1016/j.brainres.2009.06.032
59. Yacubian, J., Glascher, J., Schroeder, K., Sommer, T., Braus, D. F., & Buchel, C. (2006). Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. Journal of Neuroscience, 26, 9530-9537. doi: 10.1523/jneurosci.2915-06.2006
60. Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex, 15, 535-544. doi: 10.1093/cercor/bhh153
61. Yeung, N., & Sanfey, A. G. (2004). Independent coding of reward magnitude and valence in the human brain. Journal of Neuroscience, 24, 6258-6264. doi: 10.1523/Jneurosci.4537-03.2004
62. Zhong, S. F., Israel, S., Xue, H., Sham, P. C., Ebstein, R. P., & Chew, S. H. (2009). A neurochemical approach to valuation sensitivity over gains and losses. Proceedings of the Royal Society B: Biological Sciences, 276, 4181-4188. doi: 10.1098/rspb.2009.1312