Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum

Journal of Neurophysiology

Volumn 114, Issue 5, 2015, Pages 2600-2615

  Oyama, Kei ^a,b   Tateyama, Yukina ^a   Hernádi, István ^c   Tobler, Philippe N ^d   Iijima, Toshio ^a   Tsutsui, Ken Ichiro ^a  

^a TOHOKU UNIVERSITY   (Japan)

^b TOHOKU UNIVERSITY SCHOOL OF MEDICINE   (Japan)

^c UNIVERSITY OF PÉCS   (Hungary)

^d UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Head fixed rats; Pavlovian conditioning; Single unit recording

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; AUDITORY STIMULATION; CODING; CONDITIONING; CONTROLLED STUDY; CORPUS STRIATUM; EXPECTATION; MALE; NONHUMAN; PREDICTION; PRIORITY JOURNAL; PROBABILITY; RAT; REWARD; SINGLE UNIT ACTIVITY; STIMULUS RESPONSE; UNCERTAINTY; ANIMAL; CONDITIONED REFLEX; NEOSTRIATUM; NERVE CELL; PHYSIOLOGY; WISTAR RAT;

ACOUSTIC STIMULATION; ANIMALS; CONDITIONING, CLASSICAL; MALE; NEOSTRIATUM; NEURONS; PROBABILITY; RATS; RATS, WISTAR; REWARD;

EID: 84946854528     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00097.2015     Document Type: Article

References (50)

1. Ainslie G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82: 463-496, 1975.
2. Anden NE, Carlsson A, Dahlstroem A, Fuxe K, Hillarp NA, Larsson K. Demonstration and mapping out of nigro-neostriatal dopamine neurons. Life Sci 3: 523-530, 1964.
3. Apicella P. Leading tonically active neurons of the striatum from reward detection to context recognition. Trends Neurosci 30: 299-306, 2007.
4. Apicella P, Scarnati E, Ljunberg T, Schultz W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J Neurophysiol 68: 945-960, 1992.
5. Asaad WF, Eskandar EN. Encoding of both positive and negative reward prediction errors by neurons of the primate lateral prefrontal cortex and caudate nucleus. J Neurosci 31: 17772-17787, 2011.
6. Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437: 1158-1161, 2005.
7. Bolam JP, Hanley JJ, Booth PA, Bevan MD. Synaptic organization of the basal ganglia. J Anat 196: 527-542, 2000.
8. Bordi F, LeDoux J. Sensory tuning beyond the sensory system: an initial analysis of auditory response properties of neurons in the lateral amygdaloid nucleus and overlying areas of the striatum. J Neurosci 12: 2493-2503, 1992.
9. Burke CJ, Tobler PN. Coding of reward probability and risk by single neurons in animals. Front Neurosci 5: 121, 2011.
10. Cai X, Kim S, Lee D. Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69: 170-182, 2011.
11. Canales JJ, Capper-Loup C, Hu D, Choe ES, Upadhyay U, Graybiel AM. Shifts in striatal responsivity evoked by chronic stimulation of dopamine and glutamate systems. Brain 125: 2353-2363, 2002.
12. Cromwell HC, Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89: 2823-2838, 2003.
13. Doron NN, Ledoux JE, Semple MN. Redefining the tonotopic core of rat auditory cortex: physiological evidence for a posterior field. J Comp Neurol 453: 345-360, 2002.
14. Fiorillo CD, Newsome WT, Schultz W. The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 11: 966-973, 2008.
15. Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902, 2003.
16. Fiorillo CD, Yun SR, Song MR. Diversity and homogeneity in responses of midbrain dopamine neurons. J Neurosci 33: 4693-4709, 2013.
17. Graybiel AM. The basal ganglia. Curr Biol 10: R509-R511, 2000.
18. Hassani OK, Cromwell HC, Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J Neurophysiol 85: 2477-2489, 2001.
19. Hikida T, Kimura K, Wada N, Funabiki K, Nakanishi S. Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior. Neuron 66: 896-907, 2010.
20. Hikosaka O, Sakamoto M, Usui S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neurophysiol 61: 780-798, 1989a.
21. Hikosaka O, Sakamoto M, Usui S. Functional properties of monkey caudate neurons. II. Visual and auditory responses. J Neurophysiol 61: 799-813, 1989b.
22. Hollerman JR, Tremblay L, Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
23. Jog MS, Kubota Y, Connolly CI, Hillegaart V, Graybiel AM. Building neural representations of habits. Science 286: 1745-1749, 1999.
24. Kahnt T, Park SQ, Haynes JD, Tobler PN. Disentangling neural representations of value and salience in the human brain. Proc Natl Acad Sci USA 111: 5000-5005, 2014.
25. Kawagoe R, Takikawa Y, Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416, 1998.
26. Kepecs A, Uchida N, Zariwala HA, Mainen ZF. Neural correlates, computation and behavioral impact of decision confidence. Nature 455: 227-231, 2008.
27. Kimura M. Behaviorally contingent property of movement-related activity of the primate putamen. J Neurophysiol 63: 1277-1296, 1990.
28. Kobayashi S, Schultz W. Influence of reward delays on responses of dopamine neurons. J Neurosci 28: 7837-7846, 2008.
29. Kravitz AV, Freeze BS, Parker PR, Kay K, Thwin MT, Deisseroth K, Kreitzer AC. Regulation of parkisonian motor behaviors by optogenetic control of basal ganglia circuitry. Nature 466: 622-626, 2010.
30. Kravitz AV, Tye LD, Kreitzer AC. Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat Neurosci 15: 816-818, 2012.
31. Lau B, Glimcher PW. Value representations in the primate striatum during matching behavior. Neuron 58: 451-463, 2008.
32. Matsumoto M, Hikosaka O. Two types of dopamine neurons distinctly convey positive and negative motivational signals. Nature 459: 837-841, 2009.
33. Nakamura K, Santos G, Matsuzaki R, Nakahara H. Differential reward coding in the subdivisions of the primate caudate during an oculomotor task. J Neurosci 32: 15963-15982, 2012.
34. Ogawa M, van der Meer MA, Esber GR, Cerri DH, Stalnaker TA, Schoenbaum G. Risk-responsive orbitofrontal neurons track acquired salience. Neuron 77: 251-258, 2013.
35. Oorschot DE. Total number of neurons in the neostriatal, pallidal, subthalamic, and substantia nigral nuclei of the rat basal ganglia: a stereological study using the Cavalieri and optical disector methods. J Comp Neurol 366: 580-599, 1996.
36. Oyama K, Hernádi I, Iijima T, Tsutsui K. Reward prediction error coding in dorsal striatal neurons. J Neurosci 30: 11447-11457, 2010.
37. Oyama K, Ohara S, Sato S, Karube F, Fujiyama F, Isomura Y, Mushiake H, Iijima T, Tsutsui KI. Long-lasting single-neuron labeling by in vivo electroporation without microscopic guidance. J Neurosci Methods 218: 139-147, 2013.
38. Packard MG, Knowlton BJ. Learning and memory functions of the basal ganglia. Annu Rev Neurosci 25: 563-593, 2002.
39. Paxinos G, Watson C. The Rat Brain in Stereotaxic Coordinates. San Diego, CA: Academic Press, 2005.
40. Reynolds JN, Hyland BI, Wickens JR. A cellular mechanism of rewardrelated learning. Nature 413: 67-70, 2001.
41. Rolls ET, Thorpe SJ, Maddison SP. Responses of striatal neurons in the behaving monkey. 1. Head of the caudate nucleus. Behav Brain Res 7: 179-210, 1983.
42. Sally SL, Kelly JB. Organization of auditory cortex in the albino rat: sound frequency. J Neurophysiol 59: 1627-1638, 1988.
43. Samejima K, Ueda Y, Doya K, Kimura M. Representation of action-specific reward values in the striatum. Science 310: 1337-1340, 2005.
44. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998.
45. Sutter ML, Schreiner CE. Physiology and topography of neurons with multipeaked tuning curves in cat primary auditory cortex. J Neurophysiol 65: 1207-1226, 1991.
46. Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: The MIT Press, 1998.
47. Tobler N, Christopoulos GI, O'Doherty JP, Dolan RJ, Schultz W. Neuronal distortions of reward probability without choice. J Neurosci 28: 11703- 11711, 2008.
48. Wickens JR, Begg AJ, Arbuthnott GW. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70: 1-5, 1996.
49. Yin HH, Knowlton BJ, Balleine BW. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19: 181-189, 2004.
50. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW. The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22: 513-523, 2005.