Delays conferred by escalating costs modulate dopamine release to rewards but not their predictors

Journal of Neuroscience

Volumn 30, Issue 36, 2010, Pages 12020-12027

  Wanat, Matthew J ^a   Kuhnen, Camelia M ^b   Phillips, Paul E M ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; CONTROLLED STUDY; COST BENEFIT ANALYSIS; CYCLIC POTENTIOMETRY; DOPAMINE RELEASE; DOPAMINERGIC TRANSMISSION; EVOKED RESPONSE; HISTOLOGY; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; RAT; REWARD; SIGNAL TRANSDUCTION; ANALYSIS OF VARIANCE; ANATOMY AND HISTOLOGY; ANIMAL; ANIMAL BEHAVIOR; ASSOCIATION; ELECTROCHEMISTRY; INSTRUMENTAL CONDITIONING; MALE; METABOLISM; PHYSIOLOGY; PROCEDURES; REINFORCEMENT; SPRAGUE DAWLEY RAT; TIME;

ANALYSIS OF VARIANCE; ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, OPERANT; CUES; DOPAMINE; ELECTROCHEMISTRY; MALE; NUCLEUS ACCUMBENS; RATS; RATS, SPRAGUE-DAWLEY; REINFORCEMENT SCHEDULE; REWARD; TIME FACTORS;

EID: 77956566146     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2691-10.2010     Document Type: Article

References (42)

1. Aberman JE, Ward SJ, Salamone JD (1998) Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive-ratio performance. Pharmacol Biochem Behav 61:341-348.
2. Alessandri J, Darcheville JC, Delevoye-Turrell Y, Zentall TR (2008) Preference for rewards that follow greater effort and greater delay. Learn Behav 36:352-358.
3. Aragona BJ, Cleaveland NA, Stuber GD, Day JJ, Carelli RM, Wightman RM (2008) Preferential enhancement of dopamine transmission within the nucleus accumbens shell by cocaine is attributable to a direct increase in phasic dopamine release events. J Neurosci 28:8821-8831.
4. Aragona BJ, Day JJ, Roitman MF, Cleaveland NA, Wightman RM, Carelli RM (2009) Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats. Eur J Neurosci 30:1889-1899.
5. Berger-Tal O, Mukherjee S, Kotler BP, Brown JS (2009) Look before you leap: is risk of injury a foraging cost? Behav Ecol Sociobiol 63:1821-1827.
6. Berridge KC (2007) The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl) 191:391-431.
7. Cagniard B, Balsam PD, Brunner D, Zhuang X (2006) Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology 31:1362-1370. (Pubitemid 43910432)
8. Clark JJ, Sandberg SG, Wanat MJ, Gan JO, Horne EA, Hart AS, Akers CA, Parker JG, Willuhn I, Martinez V, Evans SB, Stella N, Phillips PE (2010) Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat Methods 7:126-129.
9. Clement TS, Feltus JR, Kaiser DH, Zentall TR (2000) "Work ethic" in pigeons: reward value is directly related to the effort or time required to obtain the reward. Psychon Bull Rev 7:100-106.
10. Di Chiara G (2002) Nucleus accumbens shell and core dopamine: differential role in behavior and addiction. Behav Brain Res 137:75-114.
11. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902. (Pubitemid 36356659)
12. Fiorillo CD, Newsome WT, Schultz W (2008) The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 11:966-973.
13. Friedrich AM, Zentall TR (2004) Pigeons shift their preference toward locations of food that take more effort to obtain. Behav Processes 67:405-415.
14. Gan JO, Walton ME, Phillips PE (2010) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25-27.
15. Hamill S, Trevitt JT, Nowend KL, Carlson BB, Salamone JD (1999) Nucleus accumbens dopamine depletions and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacol Biochem Behav 64:21-27. (Pubitemid 29415792)
16. Heien ML, Khan AS, Ariansen JL, Cheer JF, Phillips PE, Wassum KM, Wightman RM (2005) Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. Proc Natl Acad Sci U S A 102:10023-10028.
17. Kacelnik A, Marsh B (2002) Cost can increase preference in starlings. Anim Behav 63:245-250.
18. Kobayashi S, Schultz W (2008) Influence of reward delays on responses of dopamine neurons. J Neurosci 28:7837-7846.
19. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503-507. (Pubitemid 39372453)
20. Navarro AD, Fantino E (2005) The sunk cost effect in pigeons and humans. J Exp Anal Behav 83:1-13.
21. Nowend KL, Arizzi M, Carlson BB, Salamone JD (2001) D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol Biochem Behav 69:373-382.
22. Paxinos G, Watson C (2005) The rat brain in stereotaxic coordinates. San Diego: Academic.
23. Phillips PE, Robinson DL, Stuber GD, Carelli RM, Wightman RM (2003a) Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. Methods Mol Med 79:443-464.
24. Phillips PE, Stuber GD, Heien ML, Wightman RM, Carelli RM (2003b) Subsecond dopamine release promotes cocaine seeking. Nature 422:614-618. (Pubitemid 36460414)
25. Phillips PE, Walton ME, Jhou TC (2007) Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl) 191:483-495.
26. Roesch MR, Calu DJ, Schoenbaum G (2007) Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10:1615-1624.
27. Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM (2004) Dopamine operates as a subsecond modulator of food seeking. J Neurosci 24:1265-1271.
28. Salamone JD, Correa M (2002) Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137:3-25.
29. Salamone JD, Correa M, Farrar AM, Nunes EJ, Pardo M (2009) Dopamine, behavioral economics, and effort. Front Behav Neurosci 3:13.
30. Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87-115.
31. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
32. Sokolowski JD, Salamone JD (1998) The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacol Biochem Behav 59:557-566.
33. Stephens DW, Krebs JR (1986) Foraging theory. Princeton, N.J.: Princeton University Press.
34. Stevens JR, Hallinan EV, Hauser MD (2005) The ecology and evolution of patience in two New World monkeys. Biol Lett 1:223-226. (Pubitemid 41374937)
35. Stuber GD, Klanker M, de Ridder B, Bowers MS, Joosten RN, Feenstra MG, Bonci A (2008) Reward-predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons. Science 321:1690-1692.
36. Takikawa Y, Kawagoe R, Hikosaka O (2004) A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. J Neurophysiol 92:2520-2529.
37. Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642-1645.
38. Wanchisen BA, Tatham TA, Hineline PN (1988) Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules. J Exp Anal Behav 50:375-394.
39. Wightman RM, Heien ML, Wassum KM, Sombers LA, Aragona BJ, Khan AS, Ariansen JL, Cheer JF, Phillips PE, Carelli RM (2007) Dopamine release is heterogeneous within microenvironments of the rat nucleus accumbens. Eur J Neurosci 26:2046-2054.
40. Wise RA (2004) Dopamine, learning and motivation. Nat Rev Neurosci 5:483-494.
41. Zhang L, Doyon WM, Clark JJ, Phillips PE, Dani JA (2009) Controls of tonic and phasic dopamine transmission in the dorsal and ventral striatum. Mol Pharmacol 76:396-404.
42. Zhang M, Balmadrid C, Kelley AE (2003) Nucleus accumbens opioid, GABaergic, and dopaminergic modulation of palatable food motivation: contrasting effects revealed by a progressive ratio study in the rat. Behav Neurosci 117:202-211.