Dopamine encoding of pavlovian incentive stimuli diminishes with extended training

Journal of Neuroscience

Volumn 33, Issue 8, 2013, Pages 3526-3532

  Clark, Jeremy J ^a   Collins, Anne L ^a   Sanford, Christina Akers ^a,b   Phillips, Paul E M ^a,b  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

8 CHLORO 2, 3, 4, 5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE; DOPAMINE; UNCLASSIFIED DRUG;

ANIMAL EXPERIMENT; ANIMAL TISSUE; APPETITE; ARTICLE; BEHAVIOR; CONDITIONING; DOPAMINE RELEASE; DOPAMINERGIC TRANSMISSION; HISTOLOGY; LEARNING; MALE; NONHUMAN; PRIORITY JOURNAL; RAT; REINFORCEMENT; REWARD; TASK PERFORMANCE; TRAINING;

EID: 84874205446     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5119-12.2013     Document Type: Article

References (26)

1. Berridge KC (2007) The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191:391-431. CrossRef Medline
2. Choi WY, Balsam PD, Horvitz JC (2005) Extended habit training reduces dopamine mediation of appetitive response expression. J Neurosci 25: 6729-6733. CrossRef Medline
3. Clark JJ, Sandberg SG, Wanat MJ, Gan JO, Horne EA, Hart AS, Akers CA, Parker JG, Willuhn I, Martinez V, Evans SB, Stella N, Phillips PE (2010) Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat Methods 7:126-129. CrossRef Medline
4. Clark JJ, Hollon NG, Phillips PE (2012) Pavlovian valuation systems in learning and decision making. Curr Opin Neurobiol 22:1054-1061. CrossRef Medline
5. Di Ciano P, Cardinal RN, Cowell RA, Little SJ, Everitt BJ (2001) Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J Neurosci 21:9471-9477. Medline
6. Dickinson A (1985) Actions and habits: the development of behavioural autonomy. Philos Trans R Soc Lond B 308:67-78. CrossRef
7. Dickinson A, Smith J, Mirenowicz J (2000) Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav Neurosci 114:468-483. CrossRef Medline
8. Dreyer JK, Herrik KF, Berg RW, Hounsgaard JD (2010) Influence of phasic and tonic dopamine release on receptor activation. J Neurosci 30:14273-14283. CrossRef Medline
9. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902. CrossRef Medline
10. Fiorillo CD, Newsome WT, Schultz W (2008) The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 11:966-973. CrossRef Medline
11. Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PE, Akil H (2011) A selective role for dopamine in stimulus-reward learning. Nature 469:53-57. CrossRef Medline
12. Gallistel CR, Gibbon J (2000) Time, rate, and conditioning. Psychol Rev 107:289-344. CrossRef Medline
13. Gallistel CR, Fairhurst S, Balsam P (2004) The learning curve: implications of a quantitative analysis. Proc Natl Acad Sci U S A 101:13124-13131. CrossRef Medline
14. Heien ML, Khan AS, Ariansen JL, Cheer JF, Phillips PE, Wassum KM, Wightman RM (2005) Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. Proc Natl Acad Sci U S A 102:10023-10028. CrossRef Medline
15. Janssen P, Shadlen MN (2005) A representation of the hazard rate of elapsed time in macaque area LIP. Nat Neurosci 8:234-241. CrossRef Medline
16. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163. Medline
17. McClure SM, Daw ND, Montague PR (2003) A computational substrate for incentive salience. Trends Neurosci 26:423-428. CrossRef Medline
18. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesen cephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947. Medline
19. Myers CE, Gluck MA (1994) Context, conditioning, and hippocampal rerepresentation in animal learning. Behav Neurosci 108:835-847. CrossRef Medline
20. Paxinos G, Watson C (2005) The rat brain in stereotaxic coordinates. Amsterdam: Elsevier Academic.
21. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and non-reinforcement. In: Classical conditioning II: current research and theory (Black AH, Prokasy WF, eds), pp 64-99. New York: Appleton-Century-Crofts.
22. Savastano HI, Miller RR (1998) Time as content in Pavlovian conditioning. Behav Processes 44:147-162. CrossRef
23. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27. Medline
24. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
25. Vanderschuren LJ, Di Ciano P, Everitt BJ (2005) Involvement of the dorsal striatum in cue-controlled cocaine seeking. J Neurosci 25:8665-8670. CrossRef Medline
26. Wise RA (2004) Dopamine, learning and motivation. Nat Rev Neurosci 5:483-494. CrossRef Medline