Isolating the delay component of impulsive choice in adolescent rats

Frontiers in Integrative Neuroscience

Volumn 8, Issue JAN, 2014, Pages

  McClure, Jesse ^a   Podos, Jeffrey ^a   Richardson, Heather N ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Adolescence; Delay discounting; Impulsive choice; Peak interval; Sex differences

Indexed keywords

EID: 84893404606     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2014.00003     Document Type: Article

References (76)

1. Adriani, W., Boyer, F., Gioiosa, L., Macri, S., Dreyer, J. L., and Laviola, G. (2009). Increased impulsive behavior and risk proneness following lentivirus-mediated dopamine transporter over-expression in rats' nucleus accumbens. Neuroscience 159, 47-58. doi: 10.1016/j.neuroscience.2008.11.042
2. Ainslie, G. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol. Bull. 82, 463-496. doi: 10.1037/h0076860
3. Bateson, M. (2002). Recent advances in our understanding of risk-sensitive foraging preferences. Proc. Nutr. Soc. 61, 509-516. doi: 10.1079/PNS2002181
4. Bateson, M., and Kacelnik, A. (1995). Preferences for fixed and variable food sources: variability in amount and delay. J. Exp. Anal. Behav. 63, 313-329. doi: 10.1901/jeab.1995.63-313
5. Bateson, M., and Kacelnik, A. (1996). Rate currencies and the foraging starling: the fallacy of the averages revisited. Behav. Ecol. 7, 341-352. doi: 10.1093/beheco/7.3.341
6. Bateson, M., and Kacelnik, A. (1997). Starlings' preferences for predictable and unpredictable delays to food. Anim. Behav. 53, 1129-1142. doi: 10.1006/anbe.1996.0388
7. Bateson, M., and Kacelnik, A. (1998). "Risk-sensitive foraging: decision making in variable environments, " in Cognitive Ecology, ed R. Dukas (Chicago, IL: University of Chicago Press), 297-341.
8. Bayer, H. M., and Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141. doi: 10.1016/j.neuron.2005.05.020
9. Belin, D., Mar, A., Dalley, J., Robbins, T., and Everitt, B. (2008). High impulsivity predicts the switch to compulsive cocaine-taking. Science 320, 1352-1355. doi: 10.1126/science.1158136
10. Blanchard, T. C., Pearson, J. M., and Hayden, B. Y. (2013). Postreward delays and systematic biases in measures of animal temporal discounting. Proc. Natl. Acad. Sci. U.S.A. 110, 5491-15496. doi: 10.1073/pnas.1310446110
11. Bonnot, O., Montalembert, M. d., Kermarrec, S., Botbol, M., Walter, M., and Coulon, N. (2011). Are impairments of time perception in schizophrenia a neglected phenomenon? J. Physiol. Paris 105, 164-169. doi: 10.1016/j.jphysparis.2011.07.006
12. Broos, N., Diergaarde, L., Schoffelmeer, A., Pattij, T., and De Vries, T. (2012), Trait impulsive choice predicts resistance to extinction and propensity to relapse to cocaine seeking: a bidirectional investigation. Neuropsychopharmacology 37, 1377-1386. doi: 10.1038/npp.2011.323
13. Caraco, T. (1981), Energy budgets, risk and foraging preferences in dark-eyed juncos (junco hyemalis). Behav. Ecol. Sociobiol. 8, 213-217. doi: 10.1007/BF00299833
14. Caraco, T., Martindale, S., and Whittam, T. (1980). An empirical demonstration of risk-sensitive foraging preferences. Anim. Behav. 28, 820-830. doi: 10.1016/S0003-3472(80)80142-4
15. Chambers, R. A., Taylor, J. R., and Potenza, M. N. (2003). Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. Am. J. Psychiatry 160, 1041-1052. doi: 10.1176/appi.ajp.160.6.1041
16. Cross, C. P., Copping, L. T., and Campbell, A. (2011), Sex differences in impulsivity: a meta-analysis. Psychol. Bull. 137, 97-130. doi: 10.1037/a0021591
17. D'Ardenne, K., McClure, S. M., Nystrom, L. E., and Cohen, J. D. (2008). Bold responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319, 1264-1267. doi: 10.1126/science.1150605
18. Dalley, J., Everitt, B., and Robbins, T. (2011). Impulsivity, compulsivity, and top-down cognitive control. Neuron 69, 680-694. doi: 10.1016/j.neuron.2011.01.020
19. Diergaarde, L., Pattij, T., Poortvliet, I., Hogenboom, F., de Vries, W., Schoffelmeer, A., et al. (2008). Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats. Biol. Psychiatry 63, 301-308. doi: 10.1016/j.biopsych.2007.07.011
20. Dragoi, V., Staddon, J. E., Palmer, R. G., and Buhusi, C. V. (2003). Interval timing as an emergent learning property. Psychol. Rev. 110, 126-144. doi: 10.1037/0033-295X.110.1.126
21. Feinberg, I. (1983). Schizophrenia: caused by a fault in programmed synaptic elimination during adolescence? J. Psychiatr. Res. 17, 319-334. doi: 10.1016/0022-3956(82)90038-3
22. Field, M., Christiansen, P., Cole, J., and Goudie, A. (2007). Delay discounting and the alcohol stroop in heavy drinking adolescents. Addiction 102, 579-586. doi: 10.1111/j.1360-0443.2007.01743.x
23. Forbes, E., Brown, S., Kimak, M., Ferrell, R., Manuck, S., and Hariri, A. (2007). Genetic variation in components of dopamine neurotransmission impacts ventral striatal reactivity associated with impulsivity. Mol. Psychiatry 14, 60-70. doi: 10.1038/sj.mp.4002086
24. Foster, D., and Wilson, M. (2006). Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440, 680-683. doi: 10.1038/nature04587
25. Gilpin, N., Karanikas, C., and Richardson, H. (2012). Adolescent binge drinking leads to changes in alcohol drinking, anxiety, and amygdalar corticotropin releasing factor cells in adulthood in male rats. PLoS ONE 7:e31466. doi: 10.1371/journal.pone.0031466
26. Glimcher, P. W. (2011). Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc. Natl. Acad. Sci. U.S.A. 108(Suppl. 3), 15647-15654. doi: 10.1073/pnas.1014269108
27. Goto, Y., and O'Donnell, P. (2001). Synchronous activity in the hippocampus and nucleus accumbens in vivo. J. Neurosci. 21, 1529-2401.
28. Green, L., Fry, A. F., and Myerson, J. (1994). Discounting of delayed rewards: a life-span comparison. Psychol. Sci. 5, 33-36. doi: 10.1111/j.1467-9280.1994.tb00610.x
29. Hayden, B., and Platt, M. (2009). Gambling for gatorade: risk-sensitive decision making for fluid rewards in humans. Anim. Cogn. 12, 201-207. doi: 10.1007/s10071-008-0186-8
30. Hayden, B. Y., Heilbronner, S. R., Nair, A. C., and Platt, M. L. (2008). Cognitive influences on risk-seeking by rhesus macaques. Judgm. Decis. Mak. 3, 389-395.
31. Heerey, E. A., Robinson, B. M., McMahon, R. P., and Gold, J. M. (2007). Delay discounting in schizophrenia. Cogn. Neuropsychiatry 12, 213-221. doi: 10.1080/13546800601005900
32. Jaaro-Peled, H., Hayashi-Takagi, A., Seshadri, S., Kamiya, A., Brandon, N. J., and Sawa, A. (2009). Neurodevelopmental mechanisms of schizophrenia: understanding disturbed postnatal brain maturation through neuregulin-1-erbb4 and disc1. Trends Neurosci. 32, 485-495. doi: 10.1016/j.tins.2009.05.007
33. Jensen, J. (1906). Sur les fonctions convexes et les inégalités entre les valeurs moyennes. Acta Math. 30, 175-193. doi: 10.1007/BF02418571
34. Kahneman, D., and Tversky, A. (1979). Prospect theory: an analysis of decision under risk. Econ. J. Econ. Soc. 263-291. doi: 10.2307/1914185
35. Kato, T., Abe, Y., Sotoyama, H., Kakita, A., Kominami, R., Hirokawa, S., et al. (2011). Transient exposure of neonatal mice to neuregulin-1 results in hyperdopaminergic states in adulthood: implication in neurodevelopmental hypothesis for schizophrenia. Mol. Psychiatry 16, 307-320. doi: 10.1038/mp.2010.10
36. Kühn, R., and Stamatescu, I. (2007). Learning with incomplete information and the mathematical structure behind it. Biol. Cybern. 97, 99-112. doi: 10.1007/s00422-007-0162-4
37. Kuhn, C., Johnson, M., Thomae, A., Luo, B., Simon, S. A., Zhou, G., et al. (2010). The emergence of gonadal hormone influences on dopaminergic function during puberty. Horm. Behav. 58, 122-137. doi: 10.1016/j.yhbeh.2009.10.015
38. Laviola, G., Macri{dotless}, S., Morley-Fletcher, S., and Adriani, W. (2003). Risk-taking behavior in adolescent mice: psychobiological determinants and early epigenetic influence, Neurosci. Biobehav. Rev. 27, 19-31. doi: 10.1016/S0149-7634(03)00006-X
39. Madden, G. J., Francisco, M. T., Brewer, A. T., and Stein, J. S. (2011). Delay discounting and gambling. Behav. Process. 87, 43-49. doi: 10.1016/j.beproc.2011.01.012
40. Madden, G., Petry, N., Badger, G., and Bickel, W. (1997). Impulsive and self-control choices in opioid-dependent patients and non-drug-using control patients: drug and monetary rewards. Exp. Clin. Psychopharmacol. 5, 256-262. doi: 10.1037/1064-1297.5.3.256
41. Malhotra, S., Cross, R. W. A., and van der Meer, M. A. A. (2012). Theta phase precession beyond the hippocampus. Rev. Neurosci. 23, 39-65. doi: 10.1515/revneuro-2011-0064
42. Mazur, J. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. J. Exp. Psychol. Anim. Behav. Process. 10, 426-436. doi: 10.1037/0097-7403.10.4.426
43. Mazur, J. (1986). Fixed and variable ratios and delays: further tests of an equivalence rule. J. Exp. Psychol. Anim. Behav. Process. 12, 116-124. doi: 10.1037/0097-7403.12.2.116
44. Mazur, J. E. (1988). Esitmation of indifference points with an adjusting-delay procedure. J. Exp. Anal. Behav. 49, 37-47. doi: 10.1901/jeab.1988.49-37
45. Mitchell, J., Fields, H., D'Esposito, M., and Boettiger, C. (2005). Impulsive responding in alcoholics. Alcohol. Clin. Exp. Res. 29, 2158-2169. doi: 10.1097/01.alc.0000191755.63639.4a
46. Mitchell, S. (1999). Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology 146, 455-464. doi: 10.1007/PL00005491
47. Morofushi, M., Shinohara, K., and Kimura, F. (2001). Menstrual and circadian variations in time perception in healthy women and women with premenstrual syndrome. Neurosci. Res. 41, 339-344. doi: 10.1016/S0168-0102(01)00290-5
48. Nason, M. W., Adhikari, A., Bozinoski, M., Gordon, J. A., and Role, L. W. (2011). Disrupted activity in the hippocampal-accumbens circuit of type iii neuregulin 1 mutant mice. Neuropsychopharmacology 36, 488-496. doi: 10.1038/npp.2010.180
49. Nemoda, Z., Szekely, A., and Sasvari-Szekely, M. (2011). Psychopathological aspects of dopaminergic gene polymorphisms in adolescence and young adulthood. Neurosci. Biobehav. Rev. 35, 1665-1686. doi: 10.1016/j.neubiorev.2011.04.002
50. O'Donnell, P. (1999). Ensemble coding in the nucleus accumbens. Psychobiology 27, 187-197.
51. Oberlin, B. G. and Grahame, N. J. (2009). High-alcohol preferring mice are more impulsive than low-alcohol preferring mice as measured in the delay discounting task. Alcohol. Clin. Exp. Res. 33, 1294-1303. doi: 10.1111/j.1530-0277.2009.00955.x
52. Paloyelis, Y., Asherson, P., Mehta, M. A., Faraone, S. V., and Kuntsi, J. (2010). Dat1 and comt effects on delay discounting and trait impulsivity in male adolescents with attention deficit/hyperactivity disorder and healthy controls. Neuropsychopharmacology 35, 2414-2426. doi: 10.1038/npp.2010.124
53. Pattij, T., and De Vries, T. (2013). The role of impulsivity in relapse vulnerability, Curr. Opin. Neurobiol. 3, 700-705. doi: 10.1016/j.conb.2013.01.023
54. Pennartz, C., Berke, J., Graybiel, A., Ito, R., Lansink, C., Van Der Meer, M., et al. (2009). Corticostriatal interactions during learning, memory processing, and decision making. J. Neurosci. 29, 12831-12838. doi: 10.1523/JNEUROSCI.3177-09.2009
55. Pleil, K. E., Cordes, S., Meck, W. H., and Williams, C. L. (2011). Rapid and acute effects of estrogen on time perception in male and female rats. Front. Integr. Neurosci. 5:63. doi: 10.3389/fnint.2011.00063
56. Poulos, C., Parker, J., and Le D. (1998). Increased impulsivity after injected alcohol predicts later alcohol consumption in rats: evidence for "loss-of-control drinking" and marked individual differences. Behav. Neurosci. 112, 1247-1257. doi: 10.1037/0735-7044.112.5.1247
57. Rakitin, B. C., Gibbon, J., Penney, T. B., Malapani, C., Hinton, S. C., and Meck, W. H. (1998). Scalar expectancy theory and peak-interval timing in humans. J. Exp. Psychol. Anim. Behav. Process. 24, 15-33. doi: 10.1037/0097-7403.24.1.15
58. R Core Team (2012). R: a Language and Environment for Statistical Computing. Vienna: R foundation for statistical computing. ISBN 3-900051-07-0.
59. Real, L., and Caraco, T. (1986). Risk and foraging in stochastic environments. Annu. Rev. Ecol. Syst. 17, 371-390. doi: 10.1146/annurev.es.17.110186.002103
60. Real, L., Ott, J., and Silverfine, E. (1982). On the tradeoff between the mean and the variance in foraging: effect of spatial distribution and color preference. Ecology 1617-1623. doi: 10.2307/1940101
61. Roberts, B., and DelVecchio, W. (2000). The rank-order consistency of personality traits from childhood to old age: a quantitative review of longitudinal studies. Psychol. Bull. 126, 3-25. doi: 10.1037/0033-2909.126.1.3
62. Ross, L., and Santi, A. (2000). The effects of estrogen on temporal and numerical processing in ovariectomized female rats. Psychobiology 28, 394-405. doi: 10.3758/BF03331997
63. Ruel, J., and Ayres, M. (1999). Jensen's inequality predicts effects of environmental variation. Trends Ecol. Evol. 14, 361-366. doi: 10.1016/S0169-5347(99)01664-X
64. Sandstrom, N. J. (2007). Estradiol modulation of the speed of an internal clock. Behav. Neurosci. 121, 422-432. doi: 10.1037/0735-7044.121.2.422
65. Sisk, C., and Zehr, J. (2005). Pubertal hormones organize the adolescent brain and behavior. Front. Neuroendocrinol. 26, 163-174. doi: 10.1016/j.yfrne.2005.10.003
66. Smallwood, P. D. (1996). An introduction to risk sensitivity: the use of jensen's inequality to clarify evolutionary arguments of adaptation and constraint. Am. Zool. 36, 392-401.
67. Smith, C. T., and Boettiger, C. A. (2012). Age modulates the effect of comt genotype on delay discounting behavior. Psychopharmacology 222, 609-617. doi: 10.1007/s00213-012-2653-9
68. Smith, R. (2003). Animal models of periadolescent substance abuse. Neurotoxicol. Teratol. 25, 291-301. doi: 10.1016/S0892-0362(02)00349-5
69. Spear, L. (2000). Modeling adolescent development and alcohol use in animals. Alcohol Res. Health 24, 115-123.
70. Steinberg, L., Graham, S., OBrien, L., Woolard, J., Cauffman, E., and Banich, M. (2009). Age differences in future orientation and delay discounting. Child Dev. 80, 28-44. doi: 10.1111/j.1467-8624.2008.01244.x
71. Stephens, D., Brown, J., and Ydenberg, R. (2007). Foraging: Behavior and Ecology. Chicago, IL: University of Chicago Press. doi: 10.7208/chicago/9780226772653.001.0001
72. Tobler, P. N., Fiorillo, C. D., and Schultz, W. (2005). Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645. doi: 10.1126/science.1105370
73. Van Leijenhorst, L., Zanolie, K., Van Meel, C. S., Westenberg, P. M., Rombouts, S. A., and Crone, E. A. (2010). What motivates the adolescent? brain regions mediating reward sensitivity across adolescence. Cereb. Cortex 20, 61-69. doi: 10.1093/cercor/bhp078
74. Whelan, R., Conrod, P. J., Poline, J.-B., Lourdusamy, A., Banaschewski, T., Barker, G. J., et al. (2012). Adolescent impulsivity phenotypes characterized by distinct brain networks. Nat. Neurosci. 15, 920-925. doi: 10.1038/nn.3092
75. Williams, C. L. (2012). Sex differences in counting and timing. Front. Integr. Neurosci. 5:88. doi: 10.3389/fnint.2011.00088
76. Winstanley, C., Eagle, D., and Robbins, T. (2006). Behavioral models of impulsivity in relation to adhd: translation between clinical and preclinical studies. Clin. Psychol. Rev. 26, 379-395. doi: 10.1016/j.cpr.2006.01.001