Mechanisms of impulsive choice: I. Individual differences in interval timing and reward processing

Journal of the Experimental Analysis of Behavior

Volumn 102, Issue 1, 2014, Pages 86-101

  Marshall, Andrew T ^a   Smith, Aaron P ^a   Kirkpatrick, Kimberly ^a  

^a KANSAS STATE UNIVERSITY   (United States)

Author keywords

Discounting; Impulsive behavior; Rats; Reinforcer magnitude; Timing

Indexed keywords

ANIMAL; DECISION MAKING; DELAY DISCOUNTING; IMPULSIVENESS; INDIVIDUALITY; INSTRUMENTAL CONDITIONING; MALE; RAT; REWARD; SPRAGUE DAWLEY RAT; TIME;

ANIMALS; CHOICE BEHAVIOR; CONDITIONING, OPERANT; DELAY DISCOUNTING; IMPULSIVE BEHAVIOR; INDIVIDUALITY; MALE; RATS; RATS, SPRAGUE-DAWLEY; REWARD; TIME FACTORS;

EID: 84903817289     PISSN: 00225002     EISSN: 19383711     Source Type: Journal    
DOI: 10.1002/jeab.88     Document Type: Article

References (99)

1. Ainslie, G. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82(4), 463-496.
2. Allman, M. J., & Meck, W. H. (2011). Pathophysiological distortions in time perception and timed performance. Brain, 135, 656-677. doi: 10.1093/brain/awr210
3. Andrews, M. M., Meda, S. A., Thomas, A. D., Potenza, M. N., Krystal, J. H., Worhunsky, P., ... Pearlson, G. D., (2011). Individuals' family history positive for alcoholism show functional magnetic resonance imaging differences in reward sensitivity that are related to impulsivity factors. Biological Psychiatry, 69(7), 675-683. doi: 10.1016/j.biopsych.2010.09.049
4. Baker, F., Johnson, M. W., & Bickel, W. K. (2003). Delay discounting in current and never-before cigarette smokers: similarities and differences across commodity, sign, and magnitude. Journal of Abnormal Psychology, 112(3), 382-392. doi: 10.1037/0021-843X.112.3.382
5. Ballard, K., & Knutson, B. (2009). Dissociable neural representations of future reward magnitude and delay during temporal discounting. NeuroImage, 45(1), 143-150. doi: 10.1016/j.neuroimage.2008.11.004
6. Barkley, R. A., Edwards, G., Laneri, M., Fletcher, K., & Metevia, L. (2001). Executive functioning, temporal discounting, and sense of time in adolescents with attention deficity hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD). Journal of Abnormal Child Psychology, 29(6), 541-556.
7. Baumann, A. A., & Odum, A. L. (2012). Impulsivity, risk taking, and timing. Behavioural Processes, 90, 408-414. doi: 10.1016/j.beproc.2012.04.005
8. Bechara, A., Dolan, S., & Hindes, A. (2002). Decision-making and addiction (part II): Myopia for the future or hypersensitivity to reward? Neuropsychologia, 40(10), 1690-1705. doi: 10.1016/S0028-3932(02)00016-7
9. Bickel, W. K., & Marsch, L. A. (2001). Toward a behavioral economic understanding of drug dependence: delay discounting processes. Addiction, 96, 73-86. doi: 10.1080/09652140020016978
10. Bickel, W. K., Marsch, L. A., & Carroll, M. E. (2000). Deconstructing relative reinforcing efficacy and situating the measures of pharmacological reinforcement with behavioral economics: a theoretical proposal. Psychopharmacology, 153, 44-56. doi: 10.1007/s002130000589
11. Bitsakou, P., Psychogiou, L., Thompson, M., & Sonuga-Barke, E. J. (2009). Delay aversion in attention deficit/hyperactivity disorder: an empirical investigation of the broader phenotype. Neuropsychologia, 47(2), 446-456. doi: 10.1016/j.neuropsychologia.2008.09.015
12. Bonem, M., & Crossman, E. K. (1988). Elucidating the effects of reinforcement magnitude. Psychological Bulletin, 104(3), 348-362. doi: 10.1037/0033-2909.104.3.348
13. Bruce, A. S., Black, W. R., Bruce, J. M., Daldalian, M., Martin, L. E., & Davis, A. M. (2011). Ability to delay gratification and BMI in preadolescence. Obesity, 19(5), 1101-1102. doi: 10.1038/oby.2010.297
14. Brunner, D., Gibbon, J., & Fairhurst, S. (1994). Choice between fixed and variable delays with different reward amounts. Journal of Experimental Psychology: Animal Behavior Processes, 20(4), 331-346.
15. Cardinal, R. N., Pennicott, D. R., Sugathapala, C. L., Robbins, T. W., & Everitt, B. J. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science, 292, 2499-2501.
16. Catania, A. C., & Sagvolden, T. (1980). Preference for free choice over forced choice in pigeons. Journal of the Experimental Analysis of Behavior, 34(1), 77-86. doi: 10.1901/jeab.1980.34-77
17. Cherniawsky, A. S., & Holroyd, C. B. (2013). High temporal discounters overvalue immediate rewards rather than undervalue future rewards: An event-related brain potential study. Cognitive, Affective & Behavioral Neuroscience, 13(1), 36-45. doi: 10.3758/s13415-012-0122-x
18. Church, R. M., & Deluty, M. Z. (1977). Bisection of temporal intervals. Journal of Experimental Psychology: Animal Behavior Processes, 3(3), 216-228.
19. Cooper, N., Kable, J. W., Kim, B. K., & Zauberman, G. (2013). Brain activity in valuation regions while thinking about the future predicts individual discount rates. The Journal of Neuroscience, 33(32), 13150-13156.
20. Cubillo, A., Halari, R., Smith, A., Taylor, E., & Rubia, K. (2012). A review of fronto-striatal and fronto-cortical brain abnormalities in children and adults with attention deficit hyperactivity disorder (ADHD) and new evidence for dysfunction in adults with ADHD during motivation and attention. Cortex: A Journal Devoted to the Study of the Nervous System and Behavior, 48(2), 194-215. doi: 10.1016/j.cortex.2011.04.007
21. Cui, X. (2011). Hyperbolic discounting emerges from the scalar property of interval timing. Frontiers in Integrative Neuroscience, 5(24), 1-2.
22. Darcheville, J. C., Rivière, V., & Wearden, J. H. (1992). Fixed-interval performance and self-control in children. Journal of the Experimental Analysis of Behavior, 57(2), 187-199.
23. de Wit, H. (2008). Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addiction Biology, 14, 22-31.
24. Ebert, J. E. J., & Prelec, D. (2007). The fragility of time: time-insensitivity and valuation of the near and far future. Management Science, 53(9), 1423-1438. doi: 10.1287/mnsc.1060.0671
25. Eisenberger, R., & Adornetto, M. (1986). Generalized self-control of delay and effort. Journal of Personality and Social Psychology, 51, 1020-1031.
26. Evenden, J. L. (1999). Varieties of impulsivity. Psychopharmacology, 146, 348-361.
27. Flora, S. R., & Pavlik, W. B. (1992). Human self-control and the density of reinforcement. Journal of the Experimental Analysis of Behavior, 57(2), 201-208. doi: 10.1901/jeab.1992.57-201
28. Fortin, C. (2003). Attentional time-sharing in interval timing. In W. H. Meck (Ed.), Functional and neural mechanisms of interval timing (pp. 235-260). Boca Raton, FL: CRC Press.
29. Fortin, C., & Massé, N. (2000). Expecting a break in time estimation: Attentional time-sharing without concurrent processing. Journal of Experimental Psychology: Human Perception and Performance, 26, 1788-1796.
30. Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18(3), 233-239. doi: 10.1111/j.1467-9280.2007.01882.x
31. Galtress, T., Garcia, A., & Kirkpatrick, K. (2012). Individual differences in impulsive choice and timing in rats. Journal of the Experimental Analysis of Behavior, 98(1), 65-87.
32. Galtress, T., & Kirkpatrick, K. (2010a). Reward magnitude effects on temporal discrimination. Learning and Motivation, 41, 108-124. doi: 10.1016/j.lmot.2010.01.002
33. Galtress, T., & Kirkpatrick, K. (2010b). The role of the nucleus accumbens core in impulsive choice, timing, and reward processing. Behavioral Neuroscience, 124(1), 26-43.
34. Galtress, T., Kirkpatrick, K. (2012). [Reward magnitude and temporal sensitivity assessments in impulsive choice in rats.] Unpublished raw data.
35. Garcia, A., & Kirkpatrick, K. (2013). Impulsive choice behavior in four strains of rats: Evaluation of possible models of Attention-Deficit/Hyperactivity Disorder. Behavioural Brain Research, 238, 10-22.
36. George, D., & Mallery, P. (2003). SPSS for Windows Step by Step: A Simple Guide and Reference (4th ed.). Boston, MA: Allyn and Bacon.
37. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 94(3), 279-325. doi: 10.1037/0033-295X.84.3.279
38. Gibbon, J., & Church, R. M. (1981). Time left: linear versus logarithmic subjective time. Journal of Experimental Psychology: Animal Behavior Processes, 7(2), 87-108. doi: 10.1037/0097-7403.7.2.87
39. Gibbon, J., Church, R. M., Fairhurst, S., & Kacelnik, A. (1988). Scalar expectancy theory and choice between delayed rewards. Psychological Review, 95(1), 102-114.
40. Green, L., Fry, A. F., & Myerson, J. (1994). Discounting of delayed rewards: a life-span comparison. Psychological Science, 5(1), 33-36.
41. Green, L., Myerson, J., Lichtman, D., Rosen, S., & Fry, A. (1996). Temporal discounting in choice between delayed rewards: the role of age and income. Psychology and Aging, 11(1), 79-84.
42. Haldane, J. B. S. (1956). The estimation and significance of the logarithm of a ratio of frequencies. Annals of Human Genetics, 20(4), 309-311. doi: 10.1111/j.1469-1809.1955.tb01285.x
43. Han, R., & Takahashi, T. (2012). Psychophysics of time perception and valuation in temporal discounting of gain and loss. Physica A: Statistical Mechanics and its Applications, 391(24), 6568-6576. doi: 10.1016/j.physa.2012.07.012
44. Harzem, P. (1984). Experimental analysis of individual differences and personality. Journal of the Experimental Analysis of Behavior, 42(3), 385-395.
45. Heerey, E. A., Robinson, B. M., McMahon, R. P., & Gold, J. M. (2007). Delay discounting in schizophrenia. Cognitive Neuropsychiatry, 12(3), 213-221. doi: 10.1080/13546800601005900
46. Heilbronner, S. R., & Meck, W. H. (2013). Dissociations between interval timing and intertemporal choice following administration of fluoxetine, cocaine, or methamphetamine. Behavioural Processes. doi: 10.1016/j.beproc.2013.09.013
47. Hodos, W. (1961). Progressive ratio as a measure of reward strength. Science, 134(3483), 943-944. doi: 10.1126/science.134.3483.943
48. Housden, C. R., O'Sullivan, S. S., Joyce, E. M., Lees, A. J., & Roiser, J. P. (2010). Intact reward learning but elevated delay discounting in Parkinson's disease patients with impulsive-compulsive spectrum behaviors. Neuropsychopharmacology, 35, 2155-2164. doi: 10.1038/npp.2010.84
49. Imhoff, S., Harris, M., Weiser, J., & Reynolds, B. (2013). Delay discounting by depressed and non-depressed adolescent smokers and non-smokers. Drug and Alcohol Dependence. doi: 10.1016/j.drugalcdep.2013.11.014
50. Jimura, K., Myerson, J., Hilgard, J., Keighley, J., Braver, T. S., & Green, L. (2011). Domain independence and stability in young and older adults' discounting of delayed rewards. Behavioural Processes, 87(3), 253-259.
51. Johnson, M. W., Bickel, W. K., & Baker, F. (2007). Moderate drug use and delay discounting: A comparison of heavy, light, and never smokers. Experimental and Clinical Psychopharmacology, 15(2), 187-194.
52. Kable, J. W., & Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience, 10(12), 1625-1633.
53. Kalenscher, T., & van Wingerden, M. (2011). Why we should use animals to study economic decision making - a perspective. Frontiers in Neuroscience, 5, (82). doi: 10.3389/fnins.2011.00082
54. Killeen, P. R. (1995). Economics, ecologics, and mechanics: the dynamics of responding under conditions of varying motivation. Journal of the Experimental Analysis of Behavior, 64(3), 405-431. doi: 10.1901/jeab.1995.64-405
55. Kim, B. K., & Zauberman, G. (2009). Perception of anticipatory time in temporal discounting. Journal of Neuroscience, Psychology, and Economics, 2(2), 91-101.
56. Kirby, K. N. (2009). One-year temporal stability of delay-discount rates. Psychonomic Bulletin & Review, 16(3), 457-462.
57. Kirkpatrick, K., Marshall, A. T., Clarke, J., & Cain, M. E. (2013). Environmental rearing effects on impulsivity and reward sensitivity. Behavioral Neuroscience, 127, 712-724. doi: 10.1037/a0034124
58. Lawrence, K. A., Allen, J. S., & Chanen, A. M. (2010). Impulsivity in borderline personality disorder: reward-based decision-making and its relationship to emotional disorders. Journal of Personality Disorders, 24(6), 786-799. doi: 10.1521/pedi.2010.24.6.785
59. Leon, M. I., & Shadlen, M. N. (2003). Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron, 38, 317-327.
60. Locey, M. L., & Dallery, J. (2009). Isolating behavioral mechanisms of inter-temporal choice: Nicotine effects on delay discounting and amount sensitivity. Journal of the Experimental Analysis of Behavior, 91(2), 213-223.
61. MacKillop, J., & Kahler, C. W. (2009). Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug and Alcohol Dependence, 104(3), 197-203. doi: 10.1016/j.drugalcdep.2009.04.020
62. Marco, R., Miranda, A., Schlotz, W., Melia, A., Mulligan, A., Muller, U., ... Sonuga-Barke, E., (2009). Delay and reward choice in ADHD: an experimental test of the role of delay aversion. Neuropsychology, 23(3), 367-380. doi: 10.1037/a0014914
63. Marusich, J. A., Darna, M., Charnigo, R. J., Dwoskin, L. P., & Bardo, M. T. (2011). A multivariate assessment of individual differences in sensation seeking and impulsivity as predictors of amphetamine self-administration and prefrontal dopamine function in rats. Experimental and Clinical Psychopharmacology, 19(4), 275-284.
64. Matusiewicz, A. K., Carter, A. E., Landes, R. D., & Yi, R. (2013). Statistical equivalence and test-retest reliability of delay and probability discounting using real and hypothetical rewards. Behavioural Processes, 100, 116-122.
65. Mazur, J. E. (1987 /2013). An adjusting procedure for studying delayed reinforcement. In. M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative Analyses of Behavior, Vol. V (pp. 55-73). New York: Psychology Press.
66. McClure, J., Podos, J., & Richardson, H. N. (2014). Isolating the delay component of impulsive choice in adolescent rats. Frontiers in Integrative Neuroscience, 8, 3. doi: 10.3389/fnint.2014.00003
67. McGuire, J. T., & Kable, J. W. (2012). Decision makers calibrate behavioral persistence on the basis of time-interval experience. Cognition, 124(2), 216-226. doi: 10.1016/j.cognition.2012.03.008
68. McGuire, J. T., & Kable, J. W. (2013). Rational temporal predictions can underlie apparent failures to delay gratification. Psychological Review, 120(2), 395-410. doi: 10.1037/a0031910
69. McSweeney, F. K., Weatherly, J. N., & Swindell, S. (1996). Within-session changes in responding during delayed matching-to-sample and discrimination procedures. Animal Learning & Behavior, 24(3), 290-299. doi: 10.3758/BF03198977
70. Mobini, S., Body, S., Ho, M.-Y., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2002). Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology, 160, 290-298. doi: 10.1007/s00213-001-0983-0
71. Myerson, J., Green, L., & Warusawitharana, M. (2001). Area under the curve as a measure of discounting. Journal of the Experimental Analysis of Behavior, 76(2), 235-243.
72. Nenadic, I., Gaser, C., Volz, H.-P., Rammsayer, T., Häger, F., & Sauer, H. (2003). Processing of temporal information and the basal ganglia: new evidence from fMRI. Experimental Brain Research, 148, 238-246.
73. Odum, A. L. (2011a). Delay discounting: I'm a k, you're a k. Journal of the Experimental Analysis of Behavior, 96(3), 427-439.
74. Odum, A. L. (2011b). Delay discounting: Trait variable? Behavioural Processes, 87(1), 1-9.
75. Odum, A. L., & Baumann, A. A. L. (2010). Delay discounting: state and trait variable. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 39-65). Washington, DC: APA Books.
76. Ohmura, Y., Takahashi, T., Kitamura, N., & Wehr, P. (2006). Three-month stability of delay and probability discounting measures. Experimental and Clinical Psychopharmacology, 14, 318-328.
77. Perry, J. L., & Carroll, M. E. (2008). The role of impulsive behavior in drug abuse. Psychopharmacology, 200, 1-26.
78. Peters, J., & Büchel, C. (2009). Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. The Journal of Neuroscience, 29, 15727-15734.
79. Peters, J., & Büchel, C. (2010). Neural representations of subjective reward value. Behavioural Brain Research, 213, 135-141.
80. Peters, J., & Büchel, C. (2011). The neural mechanisms of inter-temporal decision-making: understanding variability. Trends in Cognitive Sciences, 15(5), 227-239.
81. Rao, S. M., Mayer, A. R., & Harrington, D. L. (2001). The evolution of brain activation during temporal processing. Nature Neuroscience, 4(3), 317-323.
82. Reynolds, B. (2006). A review of delay-discounting research with humans: Relations to drug use and gambling. Behavioural Pharmacology, 17, 651-667.
83. Ripke, S., Hübner, T., Mennigen, E., Müller, K. U., Rodehacke, S., Schmidt, D., ... Smolka, M. N., (2012). Reward processing and intertemporal decision making in adults and adolescents: The role of impulsivity and decision consistency. Brain Research, 1478, 36-47. doi: 10.1016/j.brainres.2012.08.034
84. Roberts, S. (1981). Isolation of an internal clock. Journal of Experimental Psychology: Animal Behavior Processes, 7(3), 242-268.
85. Rubia, K., Halari, R., Christakou, A., & Taylor, E. (2009). Impulsiveness as a timing disturbance: neurocognitive abnormalities in attention-deficit hyperactivity disorder during temporal processes and normalization with methylphenidate. Philosophical Transactions of the Royal Society B, 364, 1919-1931. doi: 10.1098/rstb.2009.0014
86. Shamosh, N. A., & Gray, J. A. (2008). Delay discounting and intelligence: a meta-analysis. Intelligence, 36, 289-2305. doi: 10.1016/j.intell.2007.09.004
87. Smith, A. P., Marshall, A. T., & Kirkpatrick, K. (2014). Mechanisms of impulsive choice: II. Time-based interventions to improve self-control. Manuscript submitted for publication.
88. Solanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., ... Turkel, E., (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215-228.
89. Sonuga-Barke, E. J., Taylor, E., Sembi, S., & Smith, J. (1992). Hyperactivity and delay aversion: I. The effect of delay on choice. Child Psychology & Psychiatry & Allied Disciplines), 33(2), 387-398. doi: http://dx.doi.org/10.1111/j.1469-7610 .1992.tb00874.x
90. Sripada, C. S., Gonzalez, R., Luan Phan, K., & Liberzon, T. (2011). The neural correlates of intertemporal decision-making: Contributions of subjective value, stimulus type, and trait impulsivity. Human Brain Mapping, 32(10), 1637-1648. doi: 10.1002/hbm.21136
91. Suarez, I., Lopera, F., Pineda, D., & Casini, L. (2013). The cognitive structure of time estimation impairments in adults with attention deficit hyperactivity disorder. Cognitive Neuropsychology, 30(4), 195-207. doi: 10.1080/02643294.2013.842548
92. Takahashi, T. (2005). Loss of self-control in intertemporal choice may be attributable to logarithmic time-perception. Medical Hypotheses, 65, 691-693.
93. Tatham, T. A., & Zurn, K. R. (1989). The MED-PC experimental apparatus programming system. Behavior Research Methods, Instruments, & Computers, 21(2), 294-302. doi: 10.3758/BF03205598
94. van den Broek, M. D., Bradshaw, C. M., & Szabadi, E. (1992). Performance of impulsive and non-impulsive subjects on two temporal differentiation tasks. Personality and Individual Differences, 13(2), 169-174. doi: 10.1016/0191-8869(92)90039-R
95. Verdejo-García, A., Lawrence, A. J., & Clark, L. (2008). Impulsivity as a vulnerability marker for substance-use disorders: Review of findings from high-risk research, problem gamblers and genetic association studies. Neuroscience and Biobehavioral Reviews, 32(4), 777-810. doi: 10.1016/j.neubiorev.2007.11.003
96. Weller, R. E., Cook, E. W., Avsar, K. B., & Cox, J. E. (2008). Obese women show greater delay discounting than healthy-weight women. Appetite, 51, 563-568.
97. Wilbertz, G., van Elst, L. T., Delgado, M. R., Maier, S., Feige, B., Philipsen, A., & Blechert, J. (2012). Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder. NeuroImage, 60(1), 353-361. doi: 10.1016/j.neuroimage.2011.12.011
98. Wittmann, M., & Paulus, M. P. (2008). Decision making, impulsivity and time perception. Trends in Cognitive Sciences, 12(1), 7-12. doi: 10.1016/j.tics.2007.10.004
99. Zauberman, G., Kim, B. K., Malkoc, S. A., & Bettman, J. R. (2009). Discounting time and time discounting: subjective time perception and intertemporal preferences. Journal of Marketing Research, 46(4), 543-556.