Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent

Behavioral Neuroscience

Volumn 124, Issue 2, 2010, Pages 234-247

  Puryear, Corey B ^a   Kim, Min Jung ^b   Mizumori, Sheri J Y ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Context processing; Dual encoding; Motivation; Reward prediction errors; Single units; Spatial learning

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; ASSOCIATION; BRAIN FUNCTION; BRAIN NERVE CELL; CONDITIONING; CONTROLLED STUDY; MALE; MENTAL PERFORMANCE; MOTIVATION; MOVEMENT (PHYSIOLOGY); NONHUMAN; RAT; REWARD; SPATIAL MEMORY; VENTRAL TEGMENTUM;

ACTION POTENTIALS; ANIMALS; CONDITIONING, OPERANT; CUES; MALE; MEMORY; MOTIVATION; MOTOR ACTIVITY; MOVEMENT; NEURONS; RANDOM ALLOCATION; RATS; RATS, LONG-EVANS; REWARD; SPATIAL BEHAVIOR; VENTRAL TEGMENTAL AREA;

EID: 77951626185     PISSN: 07357044     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0018865     Document Type: Article

References (55)

1. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
2. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Research. Brain Research Reviews 1998, 28:309-369.
3. Cagniard B., Balsam P.D., Brunner D., Zhuang X. Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology 2006, 31:1362-1370.
4. Cagniard B., Beeler J.A., Britt J.P., McGehee D.S., Marinelli M., Zhuang X. Dopamine scales performance in the absence of new learning. Neuron 2006, 51:541-547.
5. Cannon C.M., Palmiter R.D. Reward without dopamine. Journal of Neuroscience 2003, 23:10827-10831.
6. Doya K. Modulators of decision making. Nature Neuroscience 2008, 11:410-416.
7. Fields H.L., Hjelmstad G.O., Margolis E.B., Nicola S.M. Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annual Review of Neuroscience 2007, 30:289-316.
8. Fiorillo C.D., Newsome W.T., Schultz W. The temporal precision of reward prediction in dopamine neurons. Nature Neuroscience 2008, 11(8):966-973.
9. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
10. Floresco S.B., West A.R., Ash B., Moore H., Grace A.A. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nature Neuroscience 2003, 6:968-973.
11. Gill K.M., Mizumori S.J. Context-dependent modulation by D(1) receptors: Differential effects in hippocampus and striatum. Behavioral Neuroscience 2006, 120:377-392.
12. Grace A.A., Bunney B.S. Intracellular and extracellular electrophysiology of nigral dopaminergic neurons-1. Identification and characterization. Neuroscience 1983, 10:301-315.
13. Grace A.A., Bunney B.S. The control of firing pattern in nigral dopamine neurons: Burst firing. Journal of Neuroscience 1984, 4:2877-2890.
14. Grace A.A., Bunney B.S. The control of firing pattern in nigral dopamine neurons: Single spike firing. Journal of Neuroscience 1984, 4:2866-2876.
15. Hasselmo M.E., Giocomo L.M. Cholinergic modulation of cortical function. Journal of Molecular Neuroscience 2006, 30:133-135.
16. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience 1998, 1:304-309.
17. Hyland B.I., Reynolds J.N., Hay J., Perk C.G., Miller R. Firing modes of midbrain dopamine cells in the freely moving rat. Neuroscience 2002, 114:475-492.
18. Ihalainen J.A., Riekkinen P., Feenstra M.G. Comparison of dopamine and noradrenaline release in mouse prefrontal cortex, striatum and hippocampus using microdialysis. Neuroscience Letters 1999, 277:71-74.
19. Ikemoto S. Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Research Reviews 2007, 56:27-78.
20. Kitai S.T., Shepard P.D., Callaway J.C., Scroggs R. Afferent modulation of dopamine neuron firing patterns. Current Opinion in Neurobiology 1999, 9:690-697.
21. Kobayashi S., Schultz W. Influence of reward delays on responses of dopamine neurons. Journal of Neuroscience 2008, 28:7837-7846.
22. Kosobud A.E., Harris G.C., Chapin J.K. Behavioral associations of neuronal activity in the ventral tegmental area of the rat. Journal of Neuroscience 1994, 14:7117-7129.
23. Lee R.S., Steffensen S.C., Henriksen S.J. Discharge profiles of ventral tegmental area GABA neurons during movement, anesthesia, and the sleep-wake cycle. Journal of Neuroscience 2001, 21:1757-1766.
24. Lisman J.E., Grace A.A. The hippocampal-VTA loop: Controlling the entry of information into long-term memory. Neuron 2005, 46:703-713.
25. Lisman J.E., Otmakhova N.A. Storage, recall, and novelty detection of sequences by the hippocampus: Elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamine. Hippocampus 2001, 11:551-568.
26. Margolis E.B., Lock H., Hjelmstad G.O., Fields H.L. The ventral tegmental area revisited: Is there an electrophysiological marker for dopaminergic neurons?. Journal of Physiology 2006, 577:907-924.
27. Margolis E.B., Mitchell J.M., Ishikawa J., Hjelmstad G.O., Fields H.L. Midbrain dopamine neurons: Projection target determines action potential duration and dopamine D(2) receptor inhibition. Journal of Neuroscience 2008, 28:8908-8913.
28. Mizumori S.J., Puryear C.B., Martig A.K. Basal ganglia contributions to adaptive navigation. Behavioural Brain Research 2009, 199:32-42.
29. Mizumori S.J., Smith D.M., Puryear C.B. Hippocampal and neocortical interactions during context discrimination: Electrophysiological evidence from the rat. Hippocampus 2007, 17:851-862.
30. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience 1996, 16:1936-1947.
31. Murer M.G., Tseng K.Y., Kasanetz F., Belluscio M., Riquelme L.A. Brain oscillations, medium spiny neurons, and dopamine. Cellular and Molecular Neurobiology 2002, 22:611-632.
32. Nakahara H., Itoh H., Kawagoe R., Takikawa Y., Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 2004, 41:269-280.
33. Pan W.X., Schmidt R., Wickens J.R., Hyland B.I. Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network. Journal of Neuroscience 2005, 25:6235-6242.
34. Pecina S., Cagniard B., Berridge K.C., Aldridge J.W., Zhuang X. Hyperdopaminergic mutant mice have higher " wanting" but not " liking" for sweet rewards. Journal of Neuroscience 2003, 23:9395-9402.
35. Pratt W.E., Mizumori S.J. Characteristics of basolateral amygdala neuronal firing on a spatial memory task involving differential reward. Behavioral Neuroscience 1998, 112:554-570.
36. Pratt W.E., Mizumori S.J. Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behavioural Brain Research 2001, 123:165-183.
37. Puryear C.B., King M., Mizumori S.J. Specific changes in hippocampal spatial codes predict spatial working memory performance. Behavioural Brain Research 2006, 169:168-175.
38. Redgrave P., Gurney K. The short-latency dopamine signal: A role in discovering novel actions?. Nature Reviews Neuroscience 2006, 7(12):967-975.
39. Robinson S., Smith D.M., Mizumori S.J., Palmiter R.D. Firing properties of dopamine neurons in freely moving dopamine-deficient mice: Effects of dopamine receptor activation and anesthesia. Proceedings of the National Academy of Sciences of the United States of America 2004, 101:13329-13334.
40. Roesch M.R., Calu D.J., Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nature Neuroscience 2007, 10:1615-1624.
41. Salamone J.D., Correa M. Motivational views of reinforcement: Implications for understanding the behavioral functions of nucleus accumbens dopamine. Behavioural Brain Research 2002, 137:3-25.
42. Sara S.J. The locus coeruleus and noradrenergic modulation of cognition. Nature Reviews Neuroscience 2009, 10:211-223.
43. Schultz W. Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey. Journal of Neurophysiology 1986, 56:1439-1461.
44. Schultz W. Getting formal with dopamine and reward. Neuron 2002, 36:241-263.
45. Schultz W. Multiple dopamine functions at different time courses. Annual Review of Neuroscience 2007, 30:259-288.
46. Schultz W., Dickinson A. Neuronal coding of prediction errors. Annual Review of Neuroscience 2000, 23:473-500.
47. Smith D.M., Mizumori S.J. Learning-related development of context-specific neuronal responses to places and events: The hippocampal role in context processing. Journal of Neuroscience 2006, 26:3154-3163.
48. Suri R.E. TD models of reward predictive responses in dopamine neurons. Neural Networks 2002, 15:523-533.
49. Swanson L.W. Brain maps: Structure of the rat brain 2003, Academic Press, San Diego, CA. 3nd ed.
50. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. Journal of Neuroscience 2003, 23:10402-10410.
51. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
52. Tseng K.Y., Snyder-Keller A., O'Donnell P. Dopaminergic modulation of striatal plateau depolarizations in corticostriatal organotypic cocultures. Psychopharmacology (Berl) 2007, 191:627-640.
53. Wise R.A. Dopamine, learning and motivation. Nature Reviews Neuroscience 2004, 5:483-494.
54. Yeshenko O., Guazzelli A., Mizumori S.J. Context-dependent reorganization of spatial and movement representations by simultaneously recorded hippocampal and striatal neurons during performance of allocentric and egocentric tasks. Behavioral Neuroscience 2004, 118:751-769.
55. Zhuang X., Oosting R.S., Jones S.R., Gainetdinov R.R., Miller G.W., Caron M.G., Hen R. Hyperactivity and impaired response habituation in hyperdopaminergic mice. Proceedings of the National Academy of Sciences of the United States of America 2001, 98:1982-1987.