Nucleus accumbens and delay discounting in rats: Evidence from a new quantitative protocol for analysing inter-temporal choice

Psychopharmacology

Volumn 219, Issue 2, 2012, Pages 271-283

  Valencia Torres, L ^a   Olarte Sanchez C M ^a   Da Costa Araujo S ^a   Body, S ^a   Bradshaw, C M ^a   Szabadi, E ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Adjusting delay schedule; Delay discounting; Fourier transform; Inter temporal choice; Nucleus accumbens core; Power spectrum

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL MODEL; ANIMAL TISSUE; ARTICLE; BEHAVIOR CHANGE; BRAIN DAMAGE; CONTROLLED STUDY; DECISION MAKING; DELAY DISCOUNTING; EVIDENCE BASED MEDICINE; EXCITOTOXICITY; FEMALE; FOURIER TRANSFORMATION; HISTOPATHOLOGY; MENTAL FUNCTION; NERVE CELL LESION; NONHUMAN; NUCLEUS ACCUMBENS; POWER SPECTRUM; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; RAT; REINFORCEMENT; RESPONSE TIME; TASK PERFORMANCE;

ANIMALS; CHOICE BEHAVIOR; CONDITIONING, OPERANT; FEMALE; IMPULSIVE BEHAVIOR; MICROINJECTIONS; MODELS, PSYCHOLOGICAL; NUCLEUS ACCUMBENS; QUINOLINIC ACID; RATS; RATS, WISTAR; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; TIME FACTORS;

EID: 84856676454     PISSN: 00333158     EISSN: 14322072     Source Type: Journal    
DOI: 10.1007/s00213-011-2459-1     Document Type: Article

References (58)

1. A Acheson AM Farrar M Patak KA Hausknecht AK Kieres S Choi H de Wit JB Richards 2006 Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement Behav Brain Res 173 217 228 16884790 10.1016/j.bbr.2006.06.024 (Pubitemid 44291824)
2. GW Ainslie 1974 Impulse control in pigeons J Exp Anal Behav 21 485 489 16811760 10.1901/jeab.1974.21-485 1:STN:280:DC%2BC3cnit1yktA%3D%3D
3. GW Ainslie 1975 Specious reward: a behavioral theory of impulsiveness and impulse control Psychol Bull 82 463 492 1099599 10.1037/h0076860 1:STN:280:DyaE28%2Fht1Gjsw%3D%3D
4. K Ballard B Knutson 2009 Dissociable neural representations of future reward magnitude and delay during temporal discounting Neuroimage 45 143 150 19071223 10.1016/j.neuroimage.2008.11.004
5. K Basar T Sesia H Groenenwegen HWM Steinbusch V Visser-Vanderwalle Y Temel 2010 Nucleus accumbens and impulsivity Prog Neurobiol 92 533 557 20831892 10.1016/j.pneurobio.2010.08.007
6. G Bezzina THC Cheung K Asgari CL Hampson S Body CM Bradshaw E Szabadi IM Anderson JFW Deakin 2007 Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis Psychopharmacology 195 71 84 17659381 10.1007/s00213-007-0882-0 1:CAS:528:DC%2BD2sXhtFKitrzJ (Pubitemid 47568627)
7. G Bezzina S Body THC Cheung CL Hampson CM Bradshaw E Szabadi IM Anderson JFW Deakin 2008 Effect of disconnecting the orbital prefrontal cortex from the nucleus accumbens core on inter-temporal choice behaviour: a quantitative analysis Behav Brain Res 191 272 279 18472170 10.1016/j.bbr.2008.03.041 1:CAS:528:DC%2BD1cXmtlSgt78%3D
8. G Bezzina THC Cheung S Body JFW Deakin IM Anderson CM Bradshaw E Szabadi 2009 Quantitative analysis of the effect of lesions of the subthalamic nucleus on inter-temporal choice: further evidence for enhancement of the incentive value of food reinforcers Behav Pharmac 20 437 446 10.1097/FBP.0b013e3283305e4d 1:STN:280:DC%2BD1Mnht1Sntw%3D%3D
9. EM Bowman VJ Brown 1998 Effects of excitotoxic lesions of the rat ventral striatum on the perception of reward cost Exp Brain Res 123 439 448 9870603 10.1007/s002210050588 1:STN:280:DyaK1M%2Fos1Wmsg%3D%3D (Pubitemid 28544833)
10. RN Cardinal 2006 Neural systems implicated in delayed and probabilistic reinforcement Neural Netw 19 1277 1301 16938431 10.1016/j.neunet.2006.03.004 (Pubitemid 44472601)
11. RN Cardinal THC Cheung 2005 Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat BMC Neurosci 6 9 15691387 10.1186/1471-2202-6-9 (Pubitemid 41418265)
12. RN Cardinal NJ Howes 2005 Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats BMC Neurosci 6 37 15921529 10.1186/1471-2202-6-37 (Pubitemid 41418238)
13. RN Cardinal DR Pennicott CL Sugathapala TW Robbins BJ Everitt 2001 Impulsive choice induced in rats by lesions of the nucleus accumbens core Science 292 2499 2501 11375482 10.1126/science.1060818 1:CAS:528: DC%2BD3MXkvFWlsL4%3D (Pubitemid 32601663)
14. Cardinal RN, Robbins TW, Everitt BJ (2003) Choosing delayed rewards: perspectives from learning theory, neurochemistry, and neuroanatomy. In: Heather N, Vuchinich RE (eds) Choice, behavioral economics and addiction. Elsevier, Oxford, pp 183-213, 217-218
15. da Costa Araújo S, Body S, Hampson CL, Langley RW, Deakin JFW, Anderson IM, Bradshaw CM, Szabadi E (2009) Effects of lesions of the nucleus accumbens core on inter-temporal choice: further observations with an adjusting delay procedure. Behav Brain Res 202:272-277
16. da Costa Araújo S, Body S, Valencia-Torres L, Olarte- Sánchez CM, Bak VK, Deakin JFW, Anderson IM, Bradshaw CM, Szabadi E (2010) Choice between reinforcer delays versus between reinforcer magnitudes: Fos expression in the orbital prefrontal cortex and nucleus accumbens core. Behav Brain Res 213:269-277
17. JW Dalley AC Mar D Economidou TW Robbins 2008 Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry Pharmacol Biochem Behav 90 250 260 18272211 10.1016/j.pbb.2007.12.021 1:CAS:528: DC%2BD1cXmvFSjsro%3D
18. L Diergaarde T Pattij I Poortvliet F Hogenboom W de Vries ANM Schoffelmeer TJ De Vries 2008 Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats Biol Psychiat 63 301 308 17884016 10.1016/j.biopsych.2007.07.011 1:CAS:528:DC%2BD1cXlsVWntA%3D%3D
19. JL Evenden 1999 Varieties of impulsivity Psychopharmacology 146 348 361 10550486 10.1007/PL00005481 1:CAS:528:DyaK1MXnvVansL0%3D (Pubitemid 29513276)
20. JL Evenden CN Ryan 1996 The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement Psychopharmacology 128 161 170 8956377 10.1007/s002130050121 1:CAS:528:DyaK2sXktVaj (Pubitemid 26383303)
21. SB Floresco JR St Onge S Ghods-Sharifi CA Winstanley 2008 Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making Cog Affect Behav Neurosci 8 375 389 10.3758/CABN.8.4.375
22. L Gregorios-Pippas PN Tobler W Schultz 2009 Short-term temporal discounting of reward value in human ventral striatum J Neurophysiol 101 1507 1523 19164109 10.1152/jn.90730.2008
23. AR Hariri SM Brown DE Williamson JD Flory H de Wit SB Manuck 2006 Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity J Neurosci 26 13213 13217 17182771 10.1523/JNEUROSCI.3446-06.2006 1:CAS:528:DC%2BD2sXjsFamtg%3D%3D (Pubitemid 46011631)
24. M-Y Ho S Mobini T-J Chiang CM Bradshaw E Szabadi 1999 Theory and method in the quantitative analysis of "impulsive choice" behaviour: implications for psychopharmacology Psychopharmacology 146 362 372 10550487 10.1007/PL00005482 1:CAS:528:DyaK1MXnvVansLo%3D (Pubitemid 29513277)
25. AL Jongen-Relo J Feldon 2002 Specific neuronal protein: a new tool for histological evaluation of excitotoxic lesions Physiol Behav 76 449 456 12126979 10.1016/S0031-9384(02)00732-1 1:CAS:528:DC%2BD38XlsVOqsrk%3D (Pubitemid 34786668)
26. JW Kable PW Glimcher 2007 The neural correlates of subjective value during intertemporal choice Nature Neurosci 10 1625 1633 17982449 10.1038/nn2007 1:CAS:528:DC%2BD2sXhtlKltLfO (Pubitemid 350175876)
27. JW Kable PW Glimcher 2009 The neurobiology of decision: consensus and controversy Neuron 63 733 745 19778504 10.1016/j.neuron.2009.09.003 1:CAS:528:DC%2BD1MXhsVCjsrnJ
28. S Kheramin S Body S Mobini M-Y Ho DN Velazquez-Martinez CM Bradshaw E Szabadi JFW Deakin IM Anderson 2002 Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis Psychopharmacology 165 9 17 12474113 10.1007/s00213-002-1228-6 1:CAS:528:DC%2BD38XptlGhtL0%3D (Pubitemid 36044726)
29. S Kheramin S Body S Mobini M-Y Ho DN Velazquez-Martinez CM Bradshaw E Szabadi JFW Deakin IM Anderson 2003 Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis Behav Proc 64 239 250 10.1016/S0376-6357(03)00142-6 (Pubitemid 37324370)
30. S Kheramin S Body M-Y Ho DN Velazquez-Martinez CM Bradshaw E Szabadi JFW Deakin IM Anderson 2004 Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis Psychopharmacology 175 206 214 14991223 10.1007/s00213-004-1813-y 1:CAS:528:DC%2BD2cXnt1Grsbc%3D (Pubitemid 39222351)
31. S Kheramin S Body F Miranda Herrera CM Bradshaw E Szabadi JFW Deakin IM Anderson 2005 The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: implications for models of inter-temporal choice Behav Brain Res 156 145 152 15474659 10.1016/j.bbr.2004.05.017 1:STN:280:DC%2BD2crmt1ygsQ%3D%3D (Pubitemid 39334826)
32. PR Killeen 2009 An additive utility model of delay discounting Psychol Rev 116 602 619 19618989 10.1037/a0016414
33. PR Killeen 2011 Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid Behav Proc 87 57 63 10.1016/j.beproc.2010.12.016
34. DI Laibson 1996 An economic perspective on addiction and matching Behav Brain Sci 19 583 584 10.1017/S0140525X00043119
35. Madden GJ, Johnson PS (2010) A delay-discounting primer. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 11-37
36. JE Mazur 1984 Tests of an equivalence rule for fixed and variable reinforcer delays J Exp Psychol: Anim Behav Proc 10 426 436 10.1037/0097-7403. 10.4.426
37. Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin HC (eds) Quantitative analyses of behavior: vol. 5. The effect of delay and intervening events on reinforcement value. Erlbaum, Hillsdale, pp 55-73
38. JE Mazur 1988 Estimation of indifference points with an adjusting-delay procedure J Exp Anal Behav 49 37 47 3346621 10.1901/jeab.1988.49-37 1:STN:280:DyaL1c7lsVOhsg%3D%3D
39. JE Mazur 1997 Choice, delay, probability, and conditioned reinforcement Anim Learn Behav 25 131 147 10.3758/BF03199051 (Pubitemid 27231332)
40. JE Mazur 2001 Hyperbolic value addition and general models of animal choice Psychol Rev 108 96 112 11212635 10.1037/0033-295X.108.1.96 1:STN:280:DC%2BD3M7ktFOhsw%3D%3D (Pubitemid 33604128)
41. JE Mazur 2006 Mathematical models and the experimental analysis of behavior J Exp Anal Behav 85 285 291 10.1901/jeab.2006.65-05 (Pubitemid 44139164)
42. JE Mazur DR Biondi 2009 Delay-amount tradeoffs in choices by pigeons and rats: hyperbolic versus exponential discounting J Exp Anal Behav 91 197 211 19794834 10.1901/jeab.2009.91-197
43. SM McClure DI Laibson G Loewenstein JD Cohen 2004 Separate neural systems value immediate and delayed monetary rewards Science 306 503 507 15486304 10.1126/science.1100907 1:CAS:528:DC%2BD2cXotlCktrc%3D (Pubitemid 39372453)
44. Odum AL, Baumann AL (2010) Delay discounting: state and trait variable. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 39-65
45. Paxinos G, Watson C (1998) The rat brain in stereotaxic coordinates. Academic, New York
46. A Pine B Seymour JP Roiser P Bossaerts KJ Friston HV Curran RJ Dolan 2009 Encoding of marginal utility across time in the human brain J Neurosci 29 9575 9581 19641120 10.1523/JNEUROSCI.1126-09.2009 1:CAS:528:DC%2BD1MXpsFOnt7c%3D
47. HHJ Pothuizen AL Jongen-Relo J Feldon BK Yee 2005 Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats Eur J Neurosci 22 2605 2616 16307603 10.1111/j.1460-9568.2005.04388.x (Pubitemid 41759003)
48. HC Rachlin 2006 Notes on discounting J Exp Anal Behav 85 425 435 16776060 10.1901/jeab.2006.85-05 (Pubitemid 43836744)
49. Redish AD, Kurth-Nelson Z (2010) Neural models of delay discounting. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 123-158
50. JF Rickard Z-Q Zhang S Body CM Bradshaw E Szabadi 2009 Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules J Exp Anal Behav 91 75 87 19230513 10.1901/jeab.2009.91-75 1:STN:280: DC%2BD1M7lslWgtQ%3D%3D
51. L Valencia-Torres S da Costa Araújo CM Olarte-Sánchez S Body CM Bradshaw E Szabadi 2011 Transitional and steady-state choice behavior under an adjusting-delay schedule J Exp Anal Behav 95 57 74 10.1901/jeab.2011. 95-57
52. JD Wallis 2007 Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior Ann NY Acad Sci 1121 447 460 17846158 10.1196/annals.1401.009
53. BJ Weber SA Huettel 2008 The neural substrates of probabilistic and intertemporal decision making Brain Res 1234 104 115 18710652 10.1016/j.brainres.2008.07.105 1:CAS:528:DC%2BD1cXhtFektrnN
54. Williams J (2010) Attention-deficit/hyperactivity disorder and discounting: multiple minor traits and states. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 323-357
55. Winstanley CA (2010) The neural and neurochemical basis of discounting. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 95-121
56. M Wittmann MP Paulus 2008 Decision making, impulsivity and time perception Trends Cog Sci 12 7 12 10.1016/j.tics.2007.10.004 (Pubitemid 350300034)
57. M Wittmann DS Leland MP Paulus 2007 Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task Exp Brain Res 179 643 653 17216152 10.1007/s00221-006-0822-y (Pubitemid 46800601)
58. Yi R, Mitchell SH, Bickel WK (2010) Delay discounting and substance abuse-dependence. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 191-211