Reward prediction error signals by reticular formation neurons

Learning and Memory

Volumn 15, Issue 12, 2008, Pages 895-898

  Puryear, Corey B ^a,b   Mizumori, Sheri J Y ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; BRAIN REGION; CONTROLLED STUDY; DOPAMINERGIC NERVE CELL; ERROR; HABITUATION; MALE; MAZE TEST; MESENCEPHALON; NERVE CELL; NONHUMAN; PREDICTION; PRIORITY JOURNAL; RAT; RETICULAR FORMATION; REWARD; SIGNAL TRANSDUCTION; SPATIAL MEMORY; TASK PERFORMANCE; WORKING MEMORY;

ACTION POTENTIALS; ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, OPERANT; MALE; MEMORY, SHORT-TERM; NEURONS; RATS; RATS, LONG-EVANS; RETICULAR FORMATION; REWARD; TIME FACTORS;

EID: 57349145332     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.1072808     Document Type: Article

References (26)

1. Bayer, H.M. and Glimcher, P.W. 2005. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141.
2. Christoph, G.R., Leonzio, R.J., and Wilcox, K.S. 1986. Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J. Neurosci. 6: 613-619.
3. Fabre, M., Rolls, E.T., Ashton, J.P., and Williams, G. 1983. Activity of neurons in the ventral tegmental region of the behaving monkey. Behav. Brain Res. 9: 213-235.
4. Fields, H.L., Hjelmstad, G.O., Margolis, E.B., and Nicola, S.M. 2007. Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 30: 289-316.
5. Floresco, S.B., West, A.R., Ash, B., Moore, H., and Grace, A.A. 2003. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat. Neurosci. 6: 968-973.
6. Geisler, S., Derst, C., Veh, R.W., and Zahm, D.S. 2007. Glutamatergic afferents of the ventral tegmental area in the rat. J. Neurosci. 27: 5730-5743.
7. Herkenham, M. and Nauta, W.J. 1979. Efferent connections of the habenular nuclei in the rat. J. Comp. Neurol. 187: 19-47.
8. Humphries, M.D., Gurney, K., and Prescott, T.J. 2007. Is there a brainstem substrate for action selection? Philos. Trans. R. Soc. Lond. B Biol. Sci. 362: 1627-1639.
9. Huttenlocher, P.R. 1961. Evoked and spontaneous activity in single units of medial brain stem during natural sleep and waking. J. Neurophysiol. 24: 451-468.
10. Kasamatsu, T. 1970. Maintained and evoked unit activity in the mesencephalic reticular formation of the freely behaving cat. Exp. Neurol. 28: 450-470.
11. Kobayashi, Y. and Okada, K. 2007. Reward prediction error computation in the pedunculopontine tegmental nucleus neurons. Ann. N. Y. Acad. Sci. 1104: 310-323.
12. Manohar, S., Noda, H., and Adey, W.R. 1972. Behavior of mesencephalic reticular neurons in sleep and wakefulness. Exp. Neurol. 34: 140-157.
13. Matsumoto, M. and Hikosaka, O. 2007. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447: 1111-1115.
14. McNaughton, B.L., O'Keefe, J., and Barnes, C.A. 1983. The stereotrode: A new technique for simultaneous isolation of several single units in the central nervous system from multiple unit records. J. Neurosci. Methods 8: 391-397.
15. Mesulam, M.M. 1981. A cortical network for directed attention and unilateral neglect. Ann. Neurol. 10: 309-325.
16. Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., and Hikosaka, O. 2004. Dopamine neurons can represent context-dependent prediction error. Neuron 41: 269-280.
17. Nakamura, K., Matsumoto, M., and Hikosaka, O. 2008. Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus. J. Neurosci. 28: 5331-5343.
18. Pan, W.X., Schmidt, R., Wickens, J.R., and Hyland, B.I. 2005. Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network. J. Neurosci. 25: 6235-6242.
19. Pragay, E.B., Mirsky, A.F., Ray, C.L., Turner, D.F., and Mirsky, C.V. 1978. Neuronal activity in the brain stem reticular formation during performance of a "go-no go" visual attention task in the monkey. Exp. Neurol. 60: 83-95.
20. Pratt, W.E. and Mizumori, S.J. 2001. Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behav. Brain Res. 123: 165-183.
21. Puryear, C.B., King, M., and Mizumori, S.J. 2006. Specific changes in hippocampal spatial codes predict spatial working memory performance. Behav. Brain Res. 169: 168-175.
22. Schultz, W. and Dickinson, A. 2000. Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23: 473-500.
23. Swanson, L.W. 2003. Brain maps: Structure of the rat brain, 3rd ed. Academic Press, San Diego, CA.
24. Tobler, P.N., Fiorillo, C.D., and Schultz, W. 2005. Adaptive coding of reward value by dopamine neurons. Science 307: 1642-1645.
25. Watson, R.T., Heilman, K.M., Miller, B.D., and King, F.A. 1974. Neglect after mesencephalic reticular formation lesions. Neurology 24: 294-298.
26. Wise, R.A. 2004. Dopamine, learning and motivation. Nat. Rev. Neurosci. 5: 483-494.