High temporal discounters overvalue immediate rewards rather than undervalue future rewards: An event-related brain potential study

Cognitive, Affective and Behavioral Neuroscience

Volumn 13, Issue 1, 2013, Pages 36-45

  Cherniawsky, Avital S ^a   Holroyd, Clay B ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b UNIVERSITY OF VICTORIA   (Canada)

Author keywords

Decision making; Dopamine; ERP; Reward

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; BRAIN; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEMALE; HUMAN; MALE; MOTIVATION; PHYSIOLOGY; REWARD; TIME;

ADOLESCENT; ADULT; BRAIN; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; MOTIVATION; REWARD; TIME FACTORS;

EID: 84873879708     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13415-012-0122-x     Document Type: Article

References (48)

1. Ainslie, G. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463-496.
2. Alessi, S. M., & Petry, N. M. (2003). Pathological gambling severity is associated with impulsivity in a delay discounting procedure. Behavioural Processes, 64, 345-354.
3. Baker, T. E., & Holroyd, C. B. (2009). Which way do I go? Neural activation in response to feedback and spatial processing in a virtual T-maze. Cerebral Cortex, 19, 1708-1722.
4. Baker, T. E., & Holroyd, C. B. (2011). Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200. Biological Psychology, 87, 24-34.
5. Baker, T. E., Stockwell, T., Barnes, G., Haesevoets, R., Macleod, P., & Holroyd, C. B. (2010). Genetics, drugs, and cognitive control: Individual differences underlying substance dependence. International Journal of the Society for Psychophysiological Research, 47, S1.
6. Baker, T. E., Stockwell, T., Barnes, G., & Holroyd, C. B. (2011). Individual differences in substance dependence: At the intersection of brain, behaviour and cognition. Addiction Biology, 16, 458-466.
7. Ballard, K., & Knutson, B. (2009). Dissociable neural representations of future reward magnitude and delay during temporal discounting. NeuroImage, 45, 143-150.
8. Carlson, J. M., Foti, D., Mujica-Parodi, L. R., Harmon-Jones, E., & Hajcak, G. (2011). Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study. NeuroImage, 57, 1608-1616.
9. Chabris, C. F., Laibson, D. I., & Schuldt, J. P. (2008). Intertemporal choice. In S. Durlauf & L. Blume (Eds.), The new Palgrave dictionary of economics (2nd ed.). London, U.K.: Palgrave Macmillan.
10. Cohen, M. X., Elger, C. E., & Ranganath, C. (2007). Reward expectation modulates feedback-related negativity and EEG spectra. NeuroImage, 35, 968-978.
11. Eisenberg, D. T. A., MacKillop, J., Modi, M., Beauchemin, J., Dang, D., Lisman, S. A., & Wilson, D. S. (2007). Examining impulsivity as an endophenotype using a behavioral approach: A DRD2 Taql A and DRD4 48-bp VNTR association study. Behavioral and Brain Functions, 3, 2. doi: 10.1186/1744-9081-3-2
12. Eppinger, B., Kray, J., Mock, B., & Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia, 46, 521-539.
13. Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity. Human Brain Mapping, 32, 2207-2216.
14. Frederick, S., Loewenstein, G., & O'Donoghue, T. (2002). Time discounting and time preference: A critical review. Journal of Economic Literature, 40, 351-401.
15. Gratton, G., Coles, M. G. H., & Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55, 468-484. doi: 10.1016/0013-4694(83)90135-9
16. Green, L., & Myerson, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130, 769-792. doi: 10.1037/0033-2909.130.5.769
17. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71, 148-154.
18. Hariri, A. R., Brown, S. M., Williamson, D. E., Flory, J. D., de Wit, H., & Manuck, S. B. (2006). Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity. Journal of Neuroscience, 26, 13213-13217. doi: 10.1523/JNEUROSCI.3446-06.2006
19. Hewig, J., Kretschmer, N., Trippe, R. H., Hecht, H., Coles, M. G. H., Holroyd, C. B., & Miltner, W. H. (2010). Hypersensitivity to reward in problem gamblers. Biological Psychiatry, 67, 781-783. doi: 10.1016/j.biopsych. 2009.11.009
20. Holroyd, C. B., Baker, T. E., Kerns, K. A., & Müller, U. (2008a). Electrophysiological evidence of atypical motivation and reward processing in children with attention-deficit hyperactivity disorder. Neuropsychologia, 46, 2234-2242. doi: 10.1016/j.neuropsychologia.2008.02.011
21. Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709. doi: 10.1037/0033-295X.109.4.679
22. Holroyd, C. B., Hajcak, G., & Larsen, J. T. (2006). The good, the bad and the neutral: Electrophysiological responses to feedback stimuli. Brain Research, 1105, 93-101.
23. Holroyd, C. B., & Krigolson, O. E. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology, 44, 913-917. doi: 10.1111/j.1469-8986.2007.00561.x
24. Holroyd, C. B., Krigolson, O. E., & Lee, S. (2011). Reward positivity elicited by predictive cues. NeuroReport, 22, 249-252. doi: 10.1097/WNR.0b013e328345441d
25. Holroyd, C. B., Pakzad-Vaezi, K. L., & Krigolson, O. E. (2008b). The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology, 45, 688-697. doi: 10.1111/j.1469-8986.2008.00668.x
26. Holroyd, C. B., & Yeung, N. (2012). Motivation of extended behaviors by anterior cingulate cortex. Trends in Cognitive Sciences, 16, 122-128.
27. Jasper, H. H. (1958). The ten-twenty electrode system of the International Federation. Electroencephalography and Clinical Neurophysiology, 10, 371-375.
28. Kable, J. W., & Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience, 10, 1625-1633.
29. Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999). Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. Journal of Experimental Psychology. General, 128, 78-87.
30. Kobayashi, S., & Schultz, W. (2008). Influence of reward delays on responses of dopamine neurons. Journal of Neuroscience, 28, 7837-7846.
31. Luck, S. J. (2005). An introduction to the event-related potential technique. Cambridge, MA: MIT Press.
32. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Common, J. E. Mazur, & H. Rachlin (Eds.), Quantitative analyses of behavior (The effect of delay and of intervening events on reinforcement value, Vol. 5, pp. 55-73). Hillsdale, NJ: Erlbaum.
33. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007). Time discounting for primary rewards. Journal of Neuroscience, 27, 5796-5804.
34. McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 503-507. doi: 10.1126/science.1100907
35. Miltner, W. H., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials follow incorrect feedback in a time-estimation task: Evidence for a generic neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798.
36. Myerson, J., Green, L., & Warusawitharana, M. (2001). Area under the curve as a measure of discounting. Journal of Experimental Analysis of Behavior, 76, 235-243. doi: 10.1901/jeab.2001.76-235
37. Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004). Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance. Neuroscience and Biobehavioral Reviews, 28, 441-448.
38. Oberlin, B. G., & Grahame, N. J. (2009). High-alcohol preferring mice are more impulsive than low-alcohol preferring mice as measured in the delay discounting task. Alcoholism, Clinical and Experimental Research, 33, 1294-1303.
39. Parfit, D. (1971). Personal identity. Philosophical Review, 80, 3-27.
40. Perry, J. L., & Carroll, M. E. (2008). The role of impulsive behavior in drug abuse. Psychopharmacology, 200, 1-26.
41. Pine, A., Shiner, T., Seymour, B., & Dolan, R. J. (2010). Dopamine, time, and impulsivity in humans. Journal of Neuroscience, 30, 8888-8896.
42. Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006). When things are better or worse than expected: The medial frontal cortex and the allocation of processing resources. Journal of Cognitive Neuroscience, 18, 1112-1119.
43. Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of Experimental Analysis of Behavior, 55, 233-244.
44. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241-263.
45. Schultz, W. (2004). Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Current Opinion in Neurobiology, 14, 139-147.
46. Takahishi, T. (2009). Theoretical frameworks for neuroeconomics of intertemporal choice. Journal of Neuroscience, Psychology, and Economics, 2, 75-90.
47. Walsh, M. M., & Anderson, J. R. (2012). Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neuroscience and Biobehavioral Reviews, 36, 1870-1884. doi: 10.1016/j.neubiorev.2012.05.008
48. Warren, C. M., & Holroyd, C. B. (2012). The impact of deliberative strategy dissociates ERP components related to speeded responding vs reinforcement learning. Frontiers in Decision Neuroscience, 6, 1-17.