The Role of the Nucleus Accumbens Core in Impulsive Choice, Timing, and Reward Processing

Behavioral Neuroscience

Volumn 124, Issue 1, 2010, Pages 26-43

  Galtress, Tiffany ^a   Kirkpatrick, Kimberly ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b KANSAS STATE UNIVERSITY   (United States)

Author keywords

delay discounting; impulsivity; nucleus accumbens; rats; timing

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; BRAIN FUNCTION; CONTROLLED STUDY; HISTOLOGY; IMPULSIVENESS; MALE; MOTIVATION; NONHUMAN; NUCLEUS ACCUMBENS; RAT; REINFORCEMENT; REWARD;

ANIMALS; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CONDITIONING, OPERANT; IMPULSIVE BEHAVIOR; MALE; MODELS, PSYCHOLOGICAL; NUCLEUS ACCUMBENS; RATS; REINFORCEMENT SCHEDULE; REWARD; TIME FACTORS; TIME PERCEPTION;

EID: 77249133137     PISSN: 07357044     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0018464     Document Type: Article

References (78)

1. Acheson A., Farrar A.M., Patak M., Hausknecht K.A., Kieres A.K., Choi S., and Richards J.B. Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement. Behavioural Brain Research 173 (2006) 217-228
2. Balleine B., and Killcross S. Effects of ibotenic acid lesions of the nucleus accumbens on instrumental action. Behavioural Brain Research 65 (1994) 181-193
3. Barkley R.A., Edwards G., Laneri M., Fletcher K., and Metevia L. The efficacy of problem-solving communication training alone, behavior management training alone, and their combination for parent-adolescent conflict in teenagers with ADHD and ODD. Journal of Consulting and Clinical Psychology 69 (2001) 926-941
4. Belin D., Jonkman S., Dickinson A., Robbins T.W., and Everitt B.J. Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction. Behavioural Brain Research 199 (2009) 89-102
5. Bezzina G., Cheung T.H.C., Asgari K., Hampson C.L., Body S., Bradshaw C.M., and Anderson I.M. Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: A quantitative analysis. Psychopharmacology (Berlin) 195 (2007) 71-84
6. Bickel W.K., Odum A.L., and Madden G.J. Impulsivity and cigarette smoking: Delay discounting in current, never, and ex-smokers. Psychopharmacology (Berlin) 146 (1999) 447-454
7. Buhusi C.V. Dopaminergic mechanisms of interval timing and attention. In: Meck W.H. (Ed). Functional and neural mechanisms of interval timing (2003), CRC Press, Boca Raton, FL 317-338
8. Cardinal R.N., Pennicott D.R., Sugathapala C.L., Robbins T.W., and Everitt B.J. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292 (2001) 2499-2501
9. Cardinal R.N., Robbins T.W., and Everitt B.J. The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berlin) 152 (2000) 362-375
10. Cardinal R.N., Winstanley C.A., Robbins T.W., and Everitt B.J. Limbic corticostriatal systems and delayed reinforcement. Annals of the New York Academy of Sciences 1021 (2004) 33-50
11. Carelli R.N. Nucleus accumbens cell firing and rapid dopamine signalling during goal directed behaviors in rats. Neuropharmacology 47 (2004) 180-189
12. Carey M.P., Diewald L.M., Esposito F.J., Pellicano M.P., Gironi Carnevale U.A., Sergeant J.A., and Sadile A.G. Differential distribution, affinity and plasticity of dopamine D-1 and D-2 receptors in the target sites of the mesolimbic system in an animal model of ADHD. Behavioural Brain Research 94 (1998) 173-185
13. Castellanos F.X., and Tannock R. Neuroscience of attention-deficit/hyperactivity disorder: The search for endophenotypes. Nature Reviews Neuroscience 3 (2002) 617-628
14. Cheng K., Westwood R., and Crystal J.D. Memory variance in the peak procedure of timing in pigeons. Journal of Experimental Psychology: Animal Behavior Processes 19 (1993) 68-76
15. Church R.M., Meck W.H., and Gibbon J. Application of scalar timing theory to individual trials. Journal of Experimental Psychology: Animal Behavior Processes 20 (1994) 135-155
16. Corbit L.H., Muir J.L., and Balleine B. The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. The Journal of Neuroscience 21 (2001) 3251-3260
17. Correa M., Carlson B.B., Wisniecki A., and Salamone J.D. Nucleus accumbens dopamine and work requirements on interval schedules. Behavioural Brain Research 137 (2002) 179-187
18. Dixon M.R., Jacobs E.A., and Sanders S. Contextual control of delay discounting by pathological gamblers. Journal of Applied Behavior Analysis 39 (2006) 413-422
19. Dixon M.R., Marley J., and Jacobs E.A. Delay discounting by pathological gamblers. Journal of Applied Behavior Analysis 36 (2003) 449-458
20. Doya K. Modulators of decision making. Nature Neuroscience 11 (2008) 410-416
21. Everitt B.J., and Robbins T.W. Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nature Neuroscience 8 (2005) 1481-1489
22. Galtress T., and Kirkpatrick K. Reward value effects on timing in the peak procedure. Learning and Motivation 40 (2009) 109-131
23. Gibbon J., and Church R.M. Representation of time. Cognition 37 (1990) 23-54
24. Giertler C., Bohn I., and Hauber H. The rat nucleus accumbens is involved in guiding of instrumental responses by stimuli predicting reward magnitude. European Journal of Neuroscience 18 (2003) 1993-1996
25. Goto Y., and Grace A.A. Dopaminergic modualtion of limbic and cortical drive of nucleus accumbens in goal directed behavior. Nature Neuroscience 8 (2005) 805-812
26. Green L., and Estle S.J. Preference reversals with food and water reinforcers in rats. Journal of the Experimental Analysis of Behavior 79 (2003) 233-242
27. Green L., Myerson J., and Ostaszewski P. Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. Journal of Experimental Psychology: Learning, Memory, and Cognition 25 (1999) 418-427
28. Green L., Myerson J., and Ostaszewski P. Discounting of delayed rewards across the lifespan: Age differences in individual discounting functions. Behavioural Processes 46 (1999) 89-96
29. Gregorios-Pippas L., Tobler P.N., and Schultz W. Short-term temporal discounting of reward value in human ventral striatum. Journal of Neurophysiology 101 (2009) 1507-1523
30. Hackenberg T.D., and Hineline P.N. Choice in situations of time-based diminishing returns: Immediate versus delayed consequences of action. Journal of the Experimental Analysis of Behavior 57 (1992) 67-80
31. 2 receptors in the rat nucleus accumbens are involved in the guidance of instrumantal behavior by stimuli predicting reward magnitude. The Journal of Neuroscience 20 (2000) 6282-6288
32. Ito M., and Asaki K. Choice behavior of rats in a concurrent chains schedule: Amount and delay of reinforcement. Journal of the Experimental Analysis of Behavior 37 (1982) 383-392
33. Janak P.H., Chen M.-T., and Caulder T. Dynamics of neural coding in the accumbens during extinction and reinstatement of neural behavior. Behavioural Brain Research 154 (2004) 125-135
34. Johansen E.B., Aase H., Meyer A., and Sagvolden T. Attention-deficit/hyperactivity disorder (ADHD) behaviour explained by dysfunctioning reinforcement and extinction processes. Behavioural Brain Research 130 (2002) 37-45
35. Johnson M.W., and Bickel W.K. Within-subject comparison of real and hypothetical money rewards in delay discounting. Journal of the Experimental Analysis of Behavior 77 (2002) 129-146
36. Kable J.W., and Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nature Neuroscience 10 (2007) 1625
37. Kirby K.N., Petry N.M., and Bickel W.K. Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. Journal of Experimental Psychology: General 128 (1999) 78-87
38. Kirkpatrick-Steger K., Miller S.S., Betti C.A., and Wasserman E.A. Cyclic responding by pigeons on the peak timing procedure. Journal of Experimental Psychology: Animal Behavior Processes 22 (1996) 447-460
39. Knutson B., Taylor J., Kaufman M., Peterson R., and Glover G. Distributed neural representation of expected value. The Journal of Neuroscience 25 (2005) 4806-4812
40. Kobayashi S., and Schultz W. Influence of reward delays on responses of dopamine neurons. The Journal of Neuroscience 28 (2008) 7837-7846
41. Kuntsi J., Oosterlaan J., and Stevenson J. Psychological mechanisms in hyperactivity. I. Response inhibition deficit, working memory impairment, delay aversion, or something else?. Journal of Child Psychology and Psychiatry 42 (2001) 199-210
42. Ludvig E.A., Conover K., and Shizgal P. The effects of reinforcer magnitude on timing in rats. Journal of the Experimental Analysis of Behavior 87 (2007) 201-218
43. Luman M., Oosterlaan J., and Sergeant J.A. The impact of reinforcement contingencies on AD/HD: A review and theoretical appraisal. Clinical Psychology Review 25 (2005) 183-213
44. Madden G.J., Petry N.M., Badger G.J., and Bickel W.K. Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: Drug and monetary rewards. Experimental and Clinical Psychopharmacology 5 (1997) 256-262
45. Madden G.J., Smith N.G., Brewer A.T., Pinkston J.W., and Johnson P.S. Steady-state assessment of impulsive choice in Lewis and Fischer 344 rats: Between-condition delay manipulations. Journal of the Experimental Analysis of Behavior 90 (2008) 333-344
46. Maricq A.V., and Church R.M. The differential effects of haloperidol and methamphetamine on time estimation in the rat. Psychopharmacology (Berlin) 79 (1983) 10-15
47. Mazur J.E. An adjusting procedure for studying delayed reinforcement. In: Commons M.L., Mazur J.E., Nevin J.A., and Rachlin H. (Eds). Quantitative analyses of behavior. Vol. 5. The effect of delay and of intervening events on reinforcer value (1987), Erlbaum, Hillsdale, NJ 55-73
48. Mazur J.E. Hyperbolic value addition and general models of animal choice. Psychological Review 108 (2001) 96-112
49. Mazur J.E. Effects of reinforcer probability, delay, and response requirements on the choices of rats and pigeons: Possible species differences. Journal of the Experimental Analysis of Behavior 83 (2005) 263-279
50. Mazur J.E. Rats' choices between one and two delayed reinforcers. Learning & Behavior 35 (2007) 169-176
51. Mazur J.E. Species differences between rats and pigeons in choices with probabilistic and delayed reinforcers. Behavioural Processes 75 (2007) 220-224
52. Meck W.H. Neuropharmacology of timing and time perception. Cognitive Brain Research 3 (1996) 227-242
53. Meck W.H. Neuroanatomical localization of an internal clock: A functional link between mesolimbic, nigrostriatal, and mesocortical dopaminergic systems. Brain Research 1109 (2006) 93-107
54. Olausson P., Jentsch J.D., Tronson N., Neve R.L., Nestler E.J., and Taylor J.R. ΔFoSB in the nucleus accumbens regulates food-reinforced instrumental behavior and motivation. The Journal of Neuroscience 26 (2006) 9196-9204
55. Parkinson J.A., Olmstead M.C., Burns L.H., Robbins T.W., and Everitt B.J. Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive Pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine. The Journal of Neuroscience 19 (1999) 2401-2411
56. Paxinos G., and Watson C. The rat brain in stereotaxic coordinates. 3rd ed. (1996), Academic Press, New York, NY
57. Pothuizen H.H., Jongen-Relo A.L., Feldon J., and Yee B.K. Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats. European Journal of Neuroscience 22 (2005) 2605-2616
58. Robbins T.W., and Everitt B.J. Neurobehavioural mechanisms of reward and motivation. Current Opinion in Neurobiology 6 (1996) 228-236
59. Roberts S. Isolation of an internal clock. Journal of Experimental Psychology: Animal Behavior Processes 7 (1981) 242-268
60. Rodriguez M.L., and Logue A.W. Adjusting delay to reinforcement: Comparing choice in pigeons and humans. Journal of Experimental Psychology: Animal Behavior Processes 14 (1988) 105-117
61. Roesch M.R., Calu D.J., and Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nature Neuroscience 10 (2007) 1615-1624
62. Russell V. The nucleus accumbens motor limbic interface of the spontaneously hypertensive rat as studied in vitro by the superfusion slice technique. Neuroscience and Biobehavioural Reviews 24 (2000) 133-136
63. Russell V., de Villiers A., Sagvolden T., Lamm M., and Taljaard J. Altered doperminergic function in the pre-frontal cortex, nucleus accumbens and cordate-putumen of an animal model of attention-deficit hyperactivity disorder-The spontaneously hypertensive rat. Brain Research 676 (1995) 343-351
64. 3H] dopamine from brain slices suggest impaired vesicular storage of dopamine in an animal model of attention-deficit hyperactivity disorder. Behavioural Brain Research 94 (1998) 163-171
65. Sagvolden T., Aase H., Zeiner P., and Berger D. Altered reinforcement mechanisms in attention-deficit/hyperactivity disorder. Behavioural Brain Research 94 (1998) 61-71
66. Salamone J.D., Correa M., Mingote S., and Weber S.M. Nucleus accumbens dopamine and the regulation of effort in food seeking behavior: Implications for studies of natural motivation, psychiatry and drug abuse. The Journal of Pharmacology and Experimenal Theraputics 305 (2003) 1-8
67. Scheres A., Milham M.P., Knutson B., and Castellanos F.X. Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biological Psychiatry 61 (2007) 720-724
68. Schweitzer J.B., and Sulzer-Azaroff B. Self-control in boys with attention deficit hyperactivity disorder: Effects of added stimulation and time. Journal of Child Psychology and Psychiatry 36 (1995) 671-686
69. Solonto M.V., Abikoff H., Sonuga-Barke E., Schachar R., Logan G.D., Wigal T., and Turkel E. The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology 29 (2001) 215-228
70. Sonuga-Barke E.J., Taylor E., Sembi S., and Smith J. Hyperactivity and delay aversion. I. The effect of delay on choice. Journal of Child Psychology and Psychiatry 33 (1992) 387-398
71. Spicer J., Galvan A., Hare T.A., Voss H., Glover G., and Casey B.J. Sensitivity of the nucleus accumbens to violations in expectation of reward. NeuroImage 34 (2007) 455-461
72. Swanson L.W. Brain maps: Structure of the rat brain (1998), Elsevier, Amsterdam, The Netherlands
73. Tatham T.A., and Zurn K.R. The Med-PC experimental apparatus programming system. Behavior Research Methods, Instruments, and Computers 21 (1989) 294-302
74. Tripp G., and Alsop B. Sensitivity to reward delay in children with attention deficit hyperactivity disorder (ADHD). Journal of Child Psychology and Psychiatry 42 (2001) 691-698
75. Wakabayashi K.T., Fields H.L., and Nicola S.M. Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behavioural Brain Research 154 (2004) 19-30
76. Winstanley C.A., Theobald D.E., Dalley J.W., and Robbins T.W. Interactions between serotonin and dopamine in the control of impulsive choice in rats: Therapeutic implications for impulse control disorders. Neuropsychopharmacology 30 (2005) 669-682
77. Yun I.A., Nicola I.M., and Fields H.M. Contrasting effects of dopamine and glutamate receptor antagonist injection in the nucleus accumbens suggest a neural mechanism underlying cue-evoked goal-directed behaviour. European Journal of Neuroscience 20 (2004) 249-263
78. Zhang M., Balmadrid C., and Kelley A. Nucleus accumbens opiod, GABAergic and dopaminergic modualtion of palatable food motivation: Contrasting effects revealed by a progressive ratio study in the rat. Behavioural Neuroscience 117 (2003) 202-211