Choice between reinforcer delays versus choice between reinforcer magnitudes: Differential Fos expression in the orbital prefrontal cortex and nucleus accumbens core

Behavioural Brain Research

Volumn 213, Issue 2, 2010, Pages 269-277

  da Costa Araujo S ^a   Body, S ^a   Torres, L V Valencia ^a   Sanchez, C M Olarte ^a   Bak, V K ^a   Deakin, J F W ^b   Anderson, I M ^b   Bradshaw, C M ^a   Szabadi, E ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Adjusting delay schedule; Adjusting magnitude schedule; Delay discounting; Fos expression; Inter temporal choice; Nucleus accumbens core; Orbital prefrontal cortex; Rat

Indexed keywords

PROTEIN FOS; PROTEIN C FOS;

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; CELL ACTIVATION; CELL DENSITY; CONTROLLED STUDY; DIET RESTRICTION; FEMALE; GENE EXPRESSION; IMMUNOHISTOCHEMISTRY; NERVE CELL; NONHUMAN; NUCLEUS ACCUMBENS; ORBITAL CORTEX; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; REINFORCEMENT; ANIMAL; BIOSYNTHESIS; DECISION MAKING; INSTRUMENTAL CONDITIONING; METABOLISM; PHYSIOLOGY; TIME; WISTAR RAT;

ANIMALS; CHOICE BEHAVIOR; CONDITIONING, OPERANT; FEMALE; NUCLEUS ACCUMBENS; PREFRONTAL CORTEX; PROTO-ONCOGENE PROTEINS C-FOS; RATS; RATS, WISTAR; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; TIME FACTORS;

EID: 77953913206     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2010.05.014     Document Type: Article

References (43)

1. Acheson A., Farrar A.M., Patak M., Hausknecht K.A., Kieres A.K., Choi S., et al. Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement. Behav Brain Res 2006, 173:217-228.
2. Ainslie G.W. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 1975, 82:463-492.
3. Ainslie G.W., Haslam N. Hyperbolic discounting. Choice over time 1990, 57-92. Russell Sage Foundation, New York. G. Lowenstein, J. Elster (Eds.).
4. Bezzina G., Cheung T.H.C., Asgari K., Hampson C.L., Body S., Bradshaw C.M., et al. Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis. Psychopharmacology 2007, 195:71-84.
5. Bezzina G., Body S., Cheung T.H.C., Hampson C.L., Bradshaw C.M., Szabadi E., et al. Effect of disconnecting the orbital prefrontal cortex from the nucleus accumbens core on inter-temporal choice behaviour: a quantitative analysis. Behav Brain Res 2008, 191:272-279.
6. Cardinal R.N. Neural systems implicated in delayed and probabilistic reinforcement. Neural Networks 2006, 19:1277-1301.
7. Cardinal R.N., Howes N. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 2005, 6:37.
8. Cardinal R.N., Pennicott D.R., Sugathapala C.L., Robbins T.W., Everitt B.J. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 2001, 292:2499-2501.
9. Cardinal R.N., Robbins T.W., Everitt B.J. Choosing delayed rewards: perspectives from learning theory, neurochemistry, and neuroanatomy. Choice, behavioral economics and addiction 2003, 183-213. Elsevier, Oxford, 217-18. N. Heather, R.E. Vuchinich (Eds.).
10. Castro A.R., Bowery N., Castro-Lopes J.M. Baclofen and midazolam alter c-fos induction by peripheral noxious and innocuous stimulation in the spinal cord of normal and monoarthritic rats. Neuropharmacology 1999, 38:1775-1788.
11. da Costa Araújo S., Body S., Hampson C.L., Langley R.W., Deakin J.F.W., Anderson I.M., et al. Effect of lesions of the nucleus accumbens core on inter-temporal choice: further observations with an adjusting-delay schedule. Behav Brain Res 2009, 202:272-277.
12. Dalley J.W., Mar A.C., Economidou D., Robbins T.W. Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol Biochem Behav 2008, 90:250-260.
13. Ho M.-Y., Wogar M.A., Bradshaw C.M., Szabadi E. Choice between delayed reinforcers: interaction between delay and deprivation level. Q J Exp Psychol 1997, 50B:193-202.
14. Ho M.-Y., Mobini S., Chiang T.-J., Bradshaw C.M., Szabadi E. Theory and method in the quantitative analysis of " impulsive choice" behaviour: implications for psychopharmacology. Psychopharmacology 1999, 146:362-372.
15. Hoffman G.E., Smith M.S., Verbalis J.G. C-Fos and related immediate early gene products as markers of activity in neuroendocrine systems. Front Neuroendocrinol 1993, 14:173-213.
16. Kheramin S., Body S., Mobini S., Ho M.-Y., Velazquez-Martinez D.N., Bradshaw C.M., et al. Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology 2002, 165:9-17.
17. Kheramin S., Body S., Mobini S., Ho M.-Y., Velazquez-Martinez D.N., Bradshaw C.M., et al. Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis. Behav Proc 2003, 64:239-250.
18. Killeen P.R. An additive-utility model of delay discounting. Psychol Rev 2009, 116:602-619.
19. Lagorio C.H., Hackenberg T.D. Risky choice in pigeons and humans: a cross-species comparison. J Exp Anal Behav 2010, 93:27-44.
20. Locey M.L., Dallery J. Isolating behavioral mechanisms of intertemporal choice: nicotine effects on delay discounting and amount sensitivity. J Exp Anal Behav 2009, 91:213-223.
21. Luhmann C.C. Temporal decision-making: insights from cognitive neuroscience. Frontiers Behav Neurosci 2009, 3(39):1-9.
22. Mazur J.E. Tests of an equivalence rule for fixed and variable reinforcer delays. J Exp Psychol: Anim Behav Proc 1984, 10:426-436.
23. Mazur J.E. Fixed and variable ratios and delays: further tests of an equivalence rule. J Exp Psychol: Anim Behav Proc 1986, 12:116-124.
24. Mazur J.E. An adjusting procedure for studying delayed reinforcement. Quantitative analyses of behavior: the effect of delay and intervening events on reinforcement value 1987, vol. 5:55-73. Erlbaum, Hillsdale, NJ.
25. Mazur J.E. Choice with certain and uncertain reinforcers in an adjusting-delay procedure. J Exp Anal Behav 1996, 66:63-73.
26. Mazur J.E. Choice, delay, probability, and conditioned reinforcement. Anim Learn Behav 1997, 25:131-147.
27. Mazur J.E. Hyperbolic value addition and general models of animal choice. Psychol Rev 2001, 108:96-112.
28. Mazur J.E. Mathematical models and the experimental analysis of behavior. J Exp Anal Behav 2006, 85:275-281.
29. Mazur J.E., Bondi D.R. Delay-amount tradeoffs in choices by pigeons and rats: hyperbolic versus exponential discounting. J Exp Anal Behav 2009, 91:197-211.
30. Mobini S., Body S., Ho M.-Y., Bradshaw C.M., Szabadi E., Deakin J.F.W., et al. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcerment. Psychopharmacology 2002, 160:290-298.
31. Paxinos G., Watson C. The rat brain in stereotaxic coordinates 1998, Academic Press, New York.
32. Pine A., Seymour B., Roiser J.P., Bossaerts P., Friston K.J., Curran H.V., et al. Encoding of marginal utility across time in the human brain. J Neurosci 2009, 29:9575-9581.
33. Pothuizen H.H.J., Jongen-Relo A.L., Feldon J., Yee B.K. Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats. Eur J Neurosci 2005, 22:2605-2616.
34. Rachlin H.C. Notes on discounting. J Exp Anal Behav 2006, 85:425-435.
35. Read D. Utility theory from Jeremy Bentham to Daniel Kahneman. London School of Economics Working Paper LSEOR 04-64:1-17.
36. Rickard J.F., Zhang Z.-Q., Body S., Bradshaw C.M., Szabadi E. Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules. J Exp Anal Behav 2009, 91:75-87.
37. Roesch M.R., Calu D.J., Burke K.A., Schoenbaum G., Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Ann NY Acad Sci 2007, 1104:21-34.
38. Rudebeck P.H., Walton M.E., Smyth A.N., Bannerman D.M., Rushworth M.F. Separate neural pathways process different decision costs. Nat Neurosci 2006, 9:1161-1168.
39. Sheng M., Greenberg M.E. The regulation and function of c-fos and other immediate early genes in the nervous system. Neuron 1990, 4:477-485.
40. von Neumann J., Morgenstern O. Theory of games and economic behavior 1944, Princeton University Press, Princeton, NJ.
41. Wallis J.D. Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior. Ann NY Acad Sci 2007, 1121:447-460.
42. Winstanley C.A. The neural basis of delay discounting. Impulsivity: the behavioral and neurological science of discounting 2010, 95-121. Americal Psychological Association, Washington, DC. G.J. Madden, W.K. Bickel (Eds.).
43. Winstanley C.A., Theobald D.E., Cardinal R.N., Robbins T.W. Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 2004, 24:4718-4722.