Reward prediction-related increases and decreases in tonic neuronal activity of the pedunculopontine tegmental nucleus

Frontiers in Integrative Neuroscience

Volumn , Issue APR 2013, 2013, Pages

  Okada, Ken ichi ^a,b   Kobayashi, Yasushi ^a,b,c  

^a OSAKA UNIVERSITY   (Japan)

^b Center for Information and Neural Networks   (Japan)

^c JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

Acetylcholine; Cholinergic; Motivation; Pedunculopontine tegmental nucleus; Reinforcement learning; Reward prediction; Tonic activity

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ANTICIPATION; ARTICLE; ASSOCIATION; CONDITIONING; CONTROLLED STUDY; CORRELATION ANALYSIS; EXPECTATION; EYE FIXATION; FEMALE; HAPLORHINI; INFORMATION PROCESSING; MALE; MOTIVATION; NERVE CELL; NERVE CELL STIMULATION; NONHUMAN; PEDUNCULOPONTINE TEGMENTAL NUCLEUS; PREDICTION; REINFORCEMENT; REWARD; SACCADIC EYE MOVEMENT; TASK PERFORMANCE;

EID: 84876848508     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2013.00036     Document Type: Article

References (54)

1. Belova, M.A., Paton, J.J., and Salzman, C.D. (2008). Moment-to-moment tracking of state value in the amygdala. J Neurosci 28, 10023-10030.
2. Beninato, M., and Spencer, R.F. (1987). A cholinergic projection to the rat substantia nigra from the pedunculopontine tegmental nucleus. Brain Res 412, 169-174.
3. Boucetta, S., and Jones, B.E. (2009). Activity profiles of cholinergic and intermingled GABAergic and putative glutamatergic neurons in the pontomesencephalic tegmentum of urethane-anesthetized rats. J Neurosci 29, 4664-4674.
4. Bromberg-Martin, E.S., Hikosaka, O., and Nakamura, K. (2010a). Coding of task reward value in the dorsal raphe nucleus. J Neurosci 30, 6262-6272.
5. Bromberg-Martin, E.S., Matsumoto, M., and Hikosaka, O. (2010b). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834.
6. Clements, J.R., and Grant, S. (1990). Glutamate-like immunoreactivity in neurons of the laterodorsal tegmental and pedunculopontine nuclei in the rat. Neurosci Lett 120, 70-73.
7. Cohen, J.Y., Haesler, S., Vong, L., Lowell, B.B., and Uchida, N. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88.
8. Conde, H., Dormont, J.F., and Farin, D. (1998). The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat. II. Effects of reversible inactivation by intracerebral microinjections. Exp Brain Res 121, 411-418.
9. Datta, S., and Siwek, D.F. (2002). Single cell activity patterns of pedunculopontine tegmentum neurons across the sleep-wake cycle in the freely moving rats. J Neurosci Res 70, 611-621.
10. Dormont, J.F., Conde, H., and Farin, D. (1998). The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat. I. Context-dependent and reinforcement-related single unit activity. Exp Brain Res 121, 401-410.
11. Doya, K. (2008). Modulators of decision making. Nat Neurosci 11, 410-416.
12. Ford, B., Holmes, C.J., Mainville, L., and Jones, B.E. (1995). GABAergic neurons in the rat pontomesencephalic tegmentum: codistribution with cholinergic and other tegmental neurons projecting to the posterior lateral hypothalamus. J Comp Neurol 363, 177-196.
13. Forster, G.L., and Blaha, C.D. (2003). Pedunculopontine tegmental stimulation evokes striatal dopamine efflux by activation of acetylcholine and glutamate receptors in the midbrain and pons of the rat. Eur J Neurosci 17, 751-762.
14. Garcia-Rill, E., and Skinner, R.D. (1988). Modulation of rhythmic function in the posterior midbrain. Neuroscience 27, 639-654.
15. Green, D.M., and Swets, J.A. (1966). Signal Detection Theory and Psychophysics. New York: Wiley.
16. Harris-Warrick, R.M. (2011). Neuromodulation and flexibility in Central Pattern Generator networks. Curr Opin Neurobiol 21, 685-692.
17. Hollerman, J.R., and Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1, 304-309.
18. Honda, T., and Semba, K. (1994). Serotonergic synaptic input to cholinergic neurons in the rat mesopontine tegmentum. Brain Res 647, 299-306.
19. Houk, J.C., Adams, J.L., and Barto, A.G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement, in Models of Information Processing in the Basal Ganglia, eds. J.C. Houk, J.L. Adams & A.G. Barto. (Cambridge, MA: MIT Press), 249-270.
20. Inglis, W.L., and Winn, P. (1995). The pedunculopontine tegmental nucleus: where the striatum meets the reticular formation. Prog Neurobiol 47, 1-29.
21. Jones, B.E. (1991). Paradoxical sleep and its chemical/structural substrates in the brain. Neuroscience 40, 637-656.
22. Joshua, M., Adler, A., Rosin, B., Vaadia, E., and Bergman, H. (2009). Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons. J Neurophysiol 101, 758-772.
23. Kayama, Y., and Koyama, Y. (2003). Control of sleep and wakefulness by brainstem monoaminergic and cholinergic neurons. Acta Neurochir Suppl 87, 3-6.
24. Kobayashi, Y., Inoue, Y., Yamamoto, M., Isa, T., and Aizawa, H. (2002). Contribution of pedunculopontine tegmental nucleus neurons to performance of visually guided saccade tasks in monkeys. J Neurophysiol 88, 715-731.
25. Kozak, R., Bowman, E.M., Latimer, M.P., Rostron, C.L., and Winn, P. (2005). Excitotoxic lesions of the pedunculopontine tegmental nucleus in rats impair performance on a test of sustained attention. Exp Brain Res 162, 257-264.
26. Leon, M.I., and Shadlen, M.N. (1999). Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24, 415-425.
27. Lokwan, S.J., Overton, P.G., Berry, M.S., and Clark, D. (1999). Stimulation of the pedunculopontine tegmental nucleus in the rat produces burst firing in A9 dopaminergic neurons. Neuroscience 92, 245-254.
28. Matsumura, M., Watanabe, K., and Ohye, C. (1997). Single-unit activity in the primate nucleus tegmenti pedunculopontinus related to voluntary arm movement. Neurosci Res 28, 155-165.
29. Mena-Segovia, J., Sims, H.M., Magill, P.J., and Bolam, J.P. (2008a). Cholinergic brainstem neurons modulate cortical gamma activity during slow oscillations. J Physiol 586, 2947-2960.
30. Mena-Segovia, J., Winn, P., and Bolam, J.P. (2008b). Cholinergic modulation of midbrain dopaminergic systems. Brain Res Rev 58, 265-271.
31. Mesulam, M.M., Mufson, E.J., Wainer, B.H., and Levey, A.I. (1983). Central cholinergic pathways in the rat: an overview based on an alternative nomenclature (Ch1-Ch6). Neuroscience 10, 1185-1201.
32. Montague, P.R., Dayan, P., and Sejnowski, T.J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16, 1936-1947.
33. Nakamura, K., Matsumoto, M., and Hikosaka, O. (2008). Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus. J Neurosci 28, 5331-5343.
34. Norton, A.B., Jo, Y.S., Clark, E.W., Taylor, C.A., and Mizumori, S.J. (2011). Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats. Eur J Neurosci 33, 1885-1896.
35. Okada, K., and Kobayashi, Y. (2009). Characterization of oculomotor and visual activities in the primate pedunculopontine tegmental nucleus during visually guided saccade tasks. Eur J Neurosci 30, 2211-2223.
36. Okada, K., Nakamura, K., and Kobayashi, Y. (2011). A neural correlate of predicted and actual reward-value information in monkey pedunculopontine tegmental and dorsal raphe nucleus during saccade tasks. Neural Plast 2011, 579840.
37. Okada, K., Toyama, K., Inoue, Y., Isa, T., and Kobayashi, Y. (2009). Different pedunculopontine tegmental neurons signal predicted and actual task rewards. J Neurosci 29, 4858-4870.
38. Pan, W.X., and Hyland, B.I. (2005). Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats. J Neurosci 25, 4725-4732.
39. Roesch, M.R., and Olson, C.R. (2003). Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. J Neurophysiol 90, 1766-1789.
40. Rompre, P.P., and Miliaressis, E. (1985). Pontine and mesencephalic substrates of self-stimulation. Brain Res 359, 246-259.
41. Rye, D.B., Saper, C.B., Lee, H.J., and Wainer, B.H. (1987). Pedunculopontine tegmental nucleus of the rat: cytoarchitecture, cytochemistry, and some extrapyramidal connections of the mesopontine tegmentum. J Comp Neurol 259, 483-528.
42. Samejima, K., Ueda, Y., Doya, K., and Kimura, M. (2005). Representation of action-specific reward values in the striatum. Science 310, 1337-1340.
43. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J Neurophysiol 80, 1-27.
44. Spann, B.M., and Grofova, I. (1992). Cholinergic and non-cholinergic neurons in the rat pedunculopontine tegmental nucleus. Anat Embryol (Berl) 186, 215-227.
45. Steininger, T.L., Rye, D.B., and Wainer, B.H. (1992). Afferent projections to the cholinergic pedunculopontine tegmental nucleus and adjacent midbrain extrapyramidal area in the albino rat. I. Retrograde tracing studies. J Comp Neurol 321, 515-543.
46. Steriade, M. (1996). Arousal: revisiting the reticular activating system. Science 272, 225-226.
47. Tachibana, Y., and Hikosaka, O. (2012). The primate ventral pallidum encodes expected reward value and regulates motor action. Neuron 76, 826-837.
48. Takakusaki, K., Oohinata-Sugimoto, J., Saitoh, K., and Habaguchi, T. (2004). Role of basal ganglia-brainstem systems in the control of postural muscle tone and locomotion. Prog Brain Res 143, 231-237.
49. Takakusaki, K., Shiroyama, T., and Kitai, S.T. (1997). Two types of cholinergic neurons in the rat tegmental pedunculopontine nucleus: electrophysiological and morphological characterization. Neuroscience 79, 1089-1109.
50. Takakusaki, K., Shiroyama, T., Yamamoto, T., and Kitai, S.T. (1996). Cholinergic and noncholinergic tegmental pedunculopontine projection neurons in rats revealed by intracellular labeling. J Comp Neurol 371, 345-361.
51. Vickery, T.J., Chun, M.M., and Lee, D. (2011). Ubiquity and specificity of reinforcement signals throughout the human brain. Neuron 72, 166-177.
52. Wang, H.L., and Morales, M. (2009). Pedunculopontine and laterodorsal tegmental nuclei contain distinct populations of cholinergic, glutamatergic and GABAergic neurons in the rat. Eur J Neurosci 29, 340-358.
53. Wilson, D.I., Maclaren, D.A., and Winn, P. (2009). Bar pressing for food: differential consequences of lesions to the anterior versus posterior pedunculopontine. Eur J Neurosci 30, 504-513.
54. Winn, P. (2008). Experimental studies of pedunculopontine functions: are they motor, sensory or integrative? Parkinsonism Relat Disord 14 Suppl 2, S194-198.