Individual differences in impulsive and risky choice: Effects of environmental rearing conditions

Behavioural Brain Research

Volumn 269, Issue , 2014, Pages 115-127

  Kirkpatrick, Kimberly ^a   Marshall, Andrew T ^a   Smith, Aaron P ^b   Koci, Juraj ^a   Park, Yoonseong ^a  

^a KANSAS STATE UNIVERSITY   (United States)

^b UNIVERSITY OF KENTUCKY   (United States)

Author keywords

Differential rearing; Impulsive choice; Individual difference; Monoamine concentration; Rat; Risky choice

Indexed keywords

NORADRENALIN; SEROTONIN; BIOGENIC AMINE;

ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; CORRELATIONAL STUDY; DECISION MAKING; HIGH PERFORMANCE LIQUID CHROMATOGRAPHY; HIGH RISK BEHAVIOR; IMPULSIVENESS; LOCOMOTION; MALE; MOTIVATION; NONHUMAN; NUCLEUS ACCUMBENS; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; REARING; REWARD; SOCIAL ISOLATION; STIMULUS; TASK PERFORMANCE; ANIMAL; ANIMAL HOUSING; BRAIN; INDIVIDUALITY; METABOLISM; MOTOR ACTIVITY; PHYSIOLOGY; SPRAGUE DAWLEY RAT; TIME; TIME PERCEPTION; UNCERTAINTY;

ANIMALS; BIOGENIC MONOAMINES; BRAIN; CHOICE BEHAVIOR; HOUSING, ANIMAL; IMPULSIVE BEHAVIOR; INDIVIDUALITY; MALE; MOTIVATION; MOTOR ACTIVITY; NUCLEUS ACCUMBENS; PREFRONTAL CORTEX; RATS, SPRAGUE-DAWLEY; REWARD; RISK-TAKING; SOCIAL ISOLATION; TIME FACTORS; TIME PERCEPTION; UNCERTAINTY;

EID: 84899817137     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2014.04.024     Document Type: Article

References (87)

1. Ainslie G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 1975, 82(4):463-496.
2. Alessi S.M., Petry N.M. Pathological gambling severity is associated with impulsivity in a delay discounting procedure. Behav Process 2003, 64:345-354.
3. Ballard K., Knutson B. Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 2009, 45:143-150. 10.1016/j.neuroimage.2008.11.004.
4. Barkley R.A., Edwards G., Laneri M., Fletcher K., Metevia L. Executive functioning, temporal discounting, and sense of time in adolescents with attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD). J Abnorm Child Psychol 2001, 29(6):541-556.
5. Baumann A.A., Odum A.L. Impulsivity, risk taking and timing. Behav Process 2012, 90:408-414.
6. Beckmann J.S., Bardo M.T. Environmental enrichment reduces attribution of incentive salience to a food-associated stimulus. Behav Brain Res 2012, 226:331-334.
7. Bickel W.K., Marsch L.A. Toward a behavioral economic understanding of drug dependence: delay discounting processes. Addiction 2001, 96(1):73-86.
8. Brenes J., Fornaguera J. Effects of environmental enrichment and social isolation on sucrose consumption and preference: associations with depressive-like behavior and ventral striatum dopamine. Neurosci Lett 2008, 436:278-282.
9. Brenes J., Rodriguez O., Fornaguera J. Differential effect of environmental enrichment and social isolation on depressive-like behavior, spontaneous activity and serotonin and norpinephrine concentration in prefrontal cortex and ventral striatum. Pharmacol Biochem Behav 2008, 89:85-93.
10. Brunner D., Hen R. Insights into the neurobiology of impulsive behavior from serotonin receptor knockout mice. Ann N Y Acad Sci 1997, 836:81-105.
11. Cain M.E., Green T.A., Bardo M.T. Environmental enrichment decreases responding for visual novelty. Behav Process 2006, 73:360-366.
12. Campbell-Meiklejohn D., Wakeley J., Herbert V., Cook J., Scollo P., Ray M.K., et al. Serotonin and dopamine play complementary roles in gambling to recover losses. Neuropsychopharmacology 2011, 36:402-410. 10.1038/npp.2010.170.
13. Cardinal R.N., Howes N.J. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 2005, 6(37):1-19. 10.1186/1471-2202-6-37.
14. Carroll M.E., Anker J.J., Perry J.L. Modeling risk factors for nicotine and other drug abuse in the preclinical laboratory. Drug Alcohol Depend 2009, 104(Supplement 1):S70-S78.
15. Church R.M., Meck W.H., Gibbon J. Application of scalar timing theory to individual trials. J Exp Psychol Anim Behav Process 1994, 20(2):135-155.
16. 2/3 receptor binding in rats. J Neurosci 2012, 32(44):15450-15457.
17. Coull J.T., Cheng R.-K., Meck W.H. Neuroanatomical and neurochemical substrates of timing. Neuropsychopharmacology 2011, 36:3-25.
18. de Wit H. Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addict Biol 2008, 14:22-31.
19. Dixon M.R., Marley J., Jacobs E.A. Delay discounting by pathological gamblers. J Appl Behav Anal 2003, 36(4):449-458.
20. Doya K. Modulators of decision making. Nat Neurosci 2008, 11(4):410-416.
21. Drechsler R., Rizzo P., Steinhausen H.-C. Decision-making on an explicit risk-taking task in preadolescents with attention-deficit/hyperactivity disorder. J Neural Transm 2008, 115(2):201-209. 10.1007/s00702-007-0814-5.
22. Evenden J.L. Varieties of impulsivity. Psychopharmacology (Berl) 1999, 146:348-361.
23. Fervaha G., Graff-Guerrero A., Zakzanis K.K., Foussias G., Agid O., Remington G. Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J Psychiatr Res 2013, 47(11):1590-1596. 10.1016/j.jpsychires.2013.08.003.
24. Fone K.C.F., Porkess M.V. Behavioural and neurochemical effects of post-weaning social isolation in rodents - relevance to development neuropsychiatric disorders. Neurosci Biobehav Rev 2008, 32:1087-1102.
25. Galtress T., Garcia A., Kirkpatrick K. Individual differences in impulsive choice and timing in rats. J Exp Anal Behav 2012, 98(1):65-87.
26. Galtress T., Kirkpatrick K. Reward value effects on timing in the peak procedure. Learn Motiv 2009, 40(2):109-131. 10.1016/j.lmot.2008.05.004.
27. Galtress T., Kirkpatrick K. The role of the nucleus accumbens core in impulsive choice, timing, and reward processing. Behav Neurosci 2010, 124(1):26-43.
28. Garcia A., Kirkpatrick K. Impulsive choice behavior in four strains of rats: evaluation of possible models of Attention-Deficit/Hyperactivity Disorder. Behav Brain Res 2013, 238:10-22.
29. Gibbon J., Church R.M. Sources of variance in an information processing theory of timing. Animal cognition 1984, 465-488. Elrbaum, Hillsdale, NJ. H.L. Roitblat, T.G. Bever, H.S. Terrace (Eds.).
30. Haldane J.B.S. The estimation and significance of the logarithm of a ratio of frequencies. Ann Hum Genet 1956, 20(4):309-311. 10.1111/j.1469-1809.1955.tb01285.x.
31. Heerey E.A., Bell-Warren K.R., Gold J.M. Decision-making impairments in the context of intact reward sensitivity in schizophrenia. Biol Psychiatry 2008, 64(1):62-69. 10.1016/j.biopsych.2008.02.015.
32. Heerey E.A., Robinson B.M., McMahon R.P., Gold J.M. Delay discounting in schizophrenia. Cogn Neuropsychiatry 2007, 12(3):213-221. 10.1080/13546800601005900.
33. Heilbronner S.R., Meck W.H. Dissociations between interval timing and intertemporal choice following administration of flouxetine, cocaine, or methamphetamine. Behav Process 2014, 101:123-134.
34. Hellemans K.G.C., Nobrega J.N., Olmstead M.C. Early environmental experience alters baseline and ethanol-induced cognitive impulsivity: relationship to forebrain 5-HT1A receptor binding. Behav Brain Res 2005, 159:207-220.
35. Imhoff S., Harris M., Weiser J., Reynolds B. Delay discounting by depressed and non-depressed adolescent smokers and non-smokers. Drug Alcohol Depend 2014, 135:152-155. 10.1016/j.drugalcdep.2013.11.014.
36. Jimura K., Myerson J., Hilgard J., Keighley J., Braver T.S., Green L. Domain independence and stability in young and older adults' discounting of delayed rewards. Behav Process 2011, 87(3):253-259.
37. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47(2):263-291. 10.2307/1914185.
38. Kirby K.N. One-year temporal stability of delay-discount rates. Psychon Bull Rev 2009, 16(3):457-462.
39. Kirkpatrick K., Marshall A.T., Clarke J., Cain M.E. Environmental rearing effects on impulsivity and reward sensitivity. Behav Neurosci 2013, 127(5):712-724. 10.1037/a0034124.
40. Lapiz M.D.S., Fulford A., Muchimapura S., Mason R., Parker T., Marsden C.A. Influence of postweaning social isolation in the rat on brain development, conditioned behavior, and neurotransmission. Neurosci Behav Physiol 2003, 33:13-29. 10.1023/A:1021171129766.
41. Laude J.R., Beckman J.S., Daniels C.W., Zentall T.R. Impulsivity affects sub-optimal gambling-like choice by pigeons. J Exp Psychol: Animal Learn Cogn 2014, 40(1):2-11. 10.1037/xan0000001.
42. MacKillop J., Kahler C.W. Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug Alcohol Depend 2009, 104(3):197-203. 10.1016/j.drugalcdep.2009.04.020.
43. Marco R., Miranda A., Melia A., MUller U., Butler L., Gabriels I., et al. Delay and reward choice in ADHD: an experimental test of the role of delay aversion. Neuropsychology 2009, 23(3):367-380.
44. Marshall A.T., Kirkpatrick K. The effects of the previous outcome on probabilistic choice in rats. J Exp Psychol Anim Behav Process 2013, 39(1):24-38. 10.1037/a0030765.
45. Marshall A.T., Smith A.P., Kirkpatrick K. Mechanisms of impulsive choice: I. Individual differences in timing and reward processing. J Exp Anal Behav 2014, (in press).
46. Matusiewicz A.K., Carter A.E., Landes R.D., Yi R. Statistical equivalence and test-retest reliability of delay and probability discounting using real and hypothetical rewards. Behav Process 2013, 100:116-122.
47. Mazur J.E. An adjusting procedure for studying delayed reinforcement. Quantitative analyses of behavior. Vol. 5. The effect of delay and of intervening events on reinforcer value 1987, 55-73. Erlbaum, Hillsdale, NJ. M.L. Commons, J.E. Mazur, J.A. Nevin, H. Rachlin (Eds.).
48. Mazur J.E. Hyperbolic value addition and general models of animal choice. Psychol Rev 2001, 108(1):96-112.
49. McClure J., Podos J., Richardson H.N. Isolating the delay component of impulsive choice in adolescent rats. Front Integr Neurosci 2014, 8(3). 10.3389/fnint.2014.00003.
50. Mobini S., Body S., Ho M.Y., Bradshaw C.M., Szabadi E., Deakin J.F., et al. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 2002, 160(3):290-298.
51. Myerson J., Green L., Hanson J.S., Holt D.D., Estle S.J. Discounting delayed and probabilistic rewards: processes and traits. J Econ Psychol 2003, 24:619-635.
52. Odum A.L. Delay discounting: I'm a k, you're a k. J Exp Anal Behav 2011, 96(3):427-439.
53. Odum A.L. Delay discounting: trait variable?. Behav Process 2011, 87(1):1-9.
54. Odum A.L., Baumann A.A.L. Delay discounting: state and trait variable. Impulsivity: the behavioral and neurological science of discounting 2010, 39-65. APA Books, Washington, DC. G.J. Madden, W.K. Bickel (Eds.).
55. Ohmura Y., Takahashi T., Kitamura N., Wehr P. Three-month stability of delay and probability discounting measures. Exp Clin Psychopharmacol 2006, 14:318-328.
56. Olausson P., Jentsch J.D., Tronson N., Neve R.L., Nestler E.J., Taylor J.R. δFoSB in the nucleus accumbens regulates food-reinforced instrumental behavior and motivation. J Neurosci 2006, 26(36):9196-9204.
57. Pattison K.F., Laude J.R., Zentall T.R. Environmental enrichment affects suboptimal, risky, gambling-like choice by pigeons. Anim Cogn 2013, 16:429-434.
58. Perry J.L., Carroll M.E. The role of impulsive behavior in drug abuse. Psychopharmacology (Berl) 2008, 200:1-26.
59. Perry J.L., Stairs D.J., Bardo M.T. Impulsive choice and environmental enrichment: effects of d-amphetamine and methylphenidate. Behav Brain Res 2008, 193(1):48-54.
60. Peters J., Büchel C. Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J Neurosci 2009, 29:15727-15734.
61. Peters J., Büchel C. The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci 2011, 15(5):227-239.
62. Pizzagalli D.A., Holmes A.J., Dillon D.G., Goetz E.L., Birk J.L., Bogdan R., et al. Reduced caudate and nucleus accumbens response to rewards in unmedicated subjects with major depressive disorder. Am J Psychiatry 2009, 166(6):702-710. 10.1176/appi.ajp.2008.08081201.
63. Platt M.L., Huettel S.A. Risky business: the neuroeconomics of decision making under uncertainty. Nat Neurosci 2008, 11(4):398-403.
64. Potenza M.N. The importance of animal models of decision making, gambling, and related behaviors: implications for translational research in addiction. Neuropsychopharmacology 2009, 34:2623-2624. 10.1038/npp.2009.152.
65. Rachlin H., Raineri A., Cross D. Subjective probability and delay. J Exp Anal Behav 1991, 55(2):233-244. 10.1901/jeab.1991.55-233.
66. Rahman S., Bardo M.T. Environmental enrichment increases ampheramine-induced glutamate neurotransmission in the nucleus accumbens: a neurochemical study. Brain Res 2008, 1197:40-46.
67. Renner M.J., Rosenzweig M.R. Enriched and impoverished environments: effects on the brain and behavior 1987, Springer-Verlag, New York.
68. Reynolds B. A review of delay-discounting research with humans: relations to drug use and gambling. Behav Pharmacol 2006, 17:651-667.
69. Richards J.B., Zhang L., Mitchell S.H., de Wit H. Delay or probability discounting in a model of impulsive behavior: effect of alcohol. J Exp Anal Behav 1999, 71:121-143.
70. Robbins T.W., Everitt B.J. Neurobehavioural mechanisms of reward and motivation. Curr Opin Neurobiol 1996, 6:228-236.
71. Roberts S. Isolation of an internal clock. J Exp Psychol Anim Behav Process 1981, 7(3):242-268.
72. Simpson J., Kelly J.P. The impact of environmental enrichment in laboratory rats - behavioural and neurochemical aspects. Behav Brain Res 2011, 222:246-264.
73. Smith A.P., Marshall A.T., Kirkpatrick K. Mechanisms of impulsive choice: II. Timing interventions to promote self-control. J Exp Anal Behav 2014, (submitted for publication).
74. Stairs D.J., Bardo M.T. Neurobehavioral effects of environmental enrichment and drug abuse vulnerability. Pharmacol Biochem Behav 2009, 92:377-382.
75. Stopper C.M., Floresco S.B. Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making. Cogn Affect Behav Neurosci 2011, 11:97-112.
76. Tatham T.A., Zurn K.R. The Med-PC experimental apparatus programming system. Behav Res Methods Instrum Comput 1989, 21(2):294-302.
77. Volkow N.D., Wang G.-J., Newcorn J.H., Kollins S.H., Wigal T.L., Telang F., et al. Motivation deficit in ADHD is associated with dysfunction of the dopamine reward pathway. Mol Psychiatry 2010, 15:1147-1154. 10.1038/mp.2010.97.
78. Ward R.D., Simpson E.H., Richards V.L., Deo G., Taylor K., Glendinning J.I., et al. Dissociation of hedonic reaction to reward and incentive motivation in an animal model of negative symptoms of schizophrenia. Neuropsychopharmacology 2012, 37(15):1699-1707. 10.1038/npp.2012.
79. Washio Y., Higgins S.T., Heil S.H., McKerchar T.L., Badger G.J., Skelly J.M., et al. Delay discounting is associated with treatment response among cocaine-dependent outpatients. Exp Clin Psychopharmacol 2011, 19(3):243-248. 10.1037/a0023617.
80. Winstanley C.A. Gambling rats: insight into impulsive and addictive behavior. Neuropsychopharmacology 2011, 36(1):359. 10.1038/npp.2010.136.
81. Winstanley C.A., Theobald D.E.H., Dalley J.W., Cardinal R.N., Robbins T.W. Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. Cereb Cortex 2006, 16:106-114.
82. Wood D.A., Buse J.E., Wellman C.L., Rebec G.V. Differential environmental exposure alters NMDA but not AMPA receptor subunit expression in nucleus accumbens core and shell. Brain Res 2005, 1042:176-183. 10.1016/j.brainres.2005.02.029.
83. Wood D.A., Rebec G.V. Environmental enrichment alters neuronal processing in the nucleus accumbens core during appetitive conditioning. Brain Res 2009, 1259:59-67. 10.1016/j.brainres.2008.12.038.
84. Zeeb F.D., Wong A.C., Winstanley C.A. Differential effects of environmental enrichment, social-housing, and isolation-rearing on a rat gambling task: dissociations between impulsive action and risky decision-making. Psychopharmacology (Berlin) 2013, 225:381-395. 10.1007/s00213-012-2822-x.
85. Zhang M., Balmadrid C., Kelley A. Nucleus accumbens opiod, GABAergic and dopaminergic modualtion of palatable food motivation: contrasting effects revealed by a progressive ratio study in the rat. Behav Neurosci 2003, 117(2):202-211.
86. Zhong S., Israel S., Xue H., Sham P.C., Ebstein R.P., Chew S.H. A neurochemical approach to valuation sensitivity over gains and losses. Proc Roy Soc B 2009, 276:4181-4188. 10.1098/rspb.2009.1312.
87. Zhu J., Apparsundarum S., Bardo M.T., Dwoskin L.P. Environmental enrichment decreases cell surface expression of the dopamine transporter in rat medial prefrontal cortex. J Neurochem 2005, 93(1):434-443.