Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term

Journal of Neuroscience

Volumn 34, Issue 3, 2014, Pages 698-704

  Hart, Andrew S ^a   Rutledge, Robb B ^b   Glimcher, Paul W ^b   Phillips, Paul E M ^a  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; CYCLIC POTENTIOMETRY; DOPAMINE RELEASE; FEEDBACK SYSTEM; HISTOLOGY; MALE; NONHUMAN; NUCLEUS ACCUMBENS; POLYMERASE CHAIN REACTION; PRIORITY JOURNAL; RAT; REWARD PREDICTION ERROR; SPIKE; TASK PERFORMANCE;

ANIMALS; CHOICE BEHAVIOR; DOPAMINE; FORECASTING; MALE; NUCLEUS ACCUMBENS; RANDOM ALLOCATION; RATS; RATS, SPRAGUE-DAWLEY; REWARD;

EID: 84892388605     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2489-13.2014     Document Type: Article

References (28)

1. Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-141. CrossRef Medline
2. Bayer HM, Lau B, Glimcher PW (2007) Statistics of midbrain dopamine neuron spike trains in the awake primate. J Neurophysiol 98:1428-1439. CrossRef Medline
3. Caplin A, DeanM (2007) Dopamine, reward prediction error, and economics. Quarterly Journal of Economics 123:663-701.
4. Caplin A, Dean M, Glimcher PW, Rutledge RB (2010) Measuring beliefs and rewards: a neuroeconomic approach. Quarterly Journal of Economics 125:923-960. CrossRef
5. Clark JJ, Sandberg SG, Wanat MJ, Gan JO, Horne EA, Hart AS, Akers CA, Parker JG, Willuhn I, Martinez V, Evans SB, Stella N, Phillips PEM (2010) Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat Methods 7:126-129. CrossRef Medline
6. Dreyer JK, Herrik KF, Berg RW, Hounsgaard JD (2010) Influence of phasic and tonic dopamine release on receptor activation. J Neurosci 30:14273-14283. CrossRef Medline
7. Esber GR, HaselgroveM (2011) Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning. Proc Biol Sci 278:2553-2561. CrossRef Medline
8. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902. CrossRef Medline
9. Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PEM, Akil H (2011) A selective role for dopamine in stimulus-reward learning. Nature 469:53-57. CrossRef Medline
10. Gan JO, Walton ME, Phillips PEM (2010) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25-27. CrossRef Medline
11. Garris PA, Ciolkowski EL, Pastore P, Wightman RM (1994) Efflux of dopamine from the synaptic cleft in the nucleus accumbens of the rat brain. J Neurosci 14:6084-6093. Medline
12. Glimcher PW (2011) Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc Natl Acad Sci U S A 108:15647-15654. CrossRef Medline
13. Howe MW, Tierney PL, Sandberg SG, Phillips PEM, Graybiel AM (2013) Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500:575-579. CrossRef Medline
14. Keithley RB, Heien ML, Wightman RM (2009) Multivariate concentration determination using principal component regression with residual analysis. Trends Analyt Chem 28:1127-1136. CrossRef Medline
15. Kishida KT, Sandberg SG, Lohrenz T, Comair YG, Sáez I, Phillips PEM, Montague PR (2011) Sub-second dopamine detection in human striatum. PLoS One 6:e23291. CrossRef Medline
16. Ljungberg T, Apicella P, SchultzW (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163. Medline
17. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947. Medline
18. Montague PR, McClure SM, Baldwin PR, Phillips PE, Budygin EA, Stuber GD, Kilpatrick MR, WightmanRM (2004) Dynamic gain control of dopamine delivery in freely moving animals. J Neurosci 24:1754-1759. CrossRef Medline
19. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H (2006) Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 9:1057-1063. CrossRef Medline
20. Paxinos G, Watson C (2005) The rat brain in stereotaxic coordinates, Ed 5. London: Elsevier Academic.
21. Phillips PEM, Walton ME, Jhou TC (2007) Calculating utility: Preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Pyschopharmacology (Berl) 191:483-495. CrossRef Medline
22. Rutledge RB, Dean M, Caplin A, Glimcher PW (2010) Testing the reward prediction error hypothesis with an axiomatic model. J Neurosci 30: 13525-13536. CrossRef Medline
23. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. CrossRef Medline
24. Steinberg EE, Keiflin R, Boivin JR, Witten IB, Deisseroth K, Janak PH (2013) A causal link between prediction errors, dopamine neurons and learning. Nat Neurosci 16:966-973 CrossRef Medline
25. Sutton RS (1988) Learning to predict by the methods of temporal differences. Machine Learning 3:9-44.
26. Venton BJ, Zhang H, Garris PA, Phillips PEM, Sulzer D, Wightman RM (2003) Real-time decoding of dopamine concentration changes in the caudate-putamen during tonic and phasic firing. J Neurochem 87:1284-1295. CrossRef Medline
27. Waelti P, Dickinson A, SchultzW (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43-48. CrossRef Medline
28. Wightman RM, Amatore C, Engstrom RC, Hale PD, Kristensen EW, Kuhr WG, May LJ (1988) Real-time characterization of dopamine overflow and uptake in the rat striatum. Neuroscience 25:513-523. CrossRef Medline