Complementary neural correlates of motivation in dopaminergic and noradrenergic neurons of monkeys

Frontiers in Behavioral Neuroscience

Volumn , Issue JULY, 2012, Pages

  Bouret, Sebastien ^a,b   Ravel, Sabrina ^a,c   Richmond, Barry J ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^b Team Motivation Brain and Behavior   (France)

^c AIX MARSEILLE UNIVERSITÉ   (France)

Author keywords

Locus coeruleus; Neuromodulation; Reward

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; DOPAMINERGIC NERVE CELL; INSTRUMENTAL CONDITIONING; LATENT PERIOD; LOCUS CERULEUS; MALE; MOTIVATION; NEUROMODULATION; NONHUMAN; NORADRENERGIC NERVE; OUTCOME ASSESSMENT; REWARD; RHESUS MONKEY; STIMULUS RESPONSE; SUBSTANTIA NIGRA PARS COMPACTA; TASK PERFORMANCE;

EID: 84864381323     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2012.00040     Document Type: Article

References (43)

1. Aghajanian, G. K., Cedarbaum, J. M., and Wang, R. Y. (1977). Evidence for norepinephrine-mediated collateral inhibition of locus coeruleus neurons. Brain Res. 136, 570-577.
2. Amiez, C., Procyk, E., Honoré, J., Sequeira, H., and Joseph, J.-P. (2003). Reward anticipation, cognition, and electrodermal activity in the conditioned monkey. Exp. Brain Res. 149, 267-275.
3. Aston-Jones, G., Shipley, M. T., Chouvet, G., Ennis, M., van Bockstaele, E. J., Pieribone, V. A., Shiekhattar, R., Akaoka, H., Drolet, G., and Astier, B. (1991). Afferent regulation of locus coeruleus neurons: anatomy, physiology and pharmacology. Prog. Brain Res. 88, 47-75.
4. Berridge, C. W., and Waterhouse, B. D. (2003). The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res. Brain Res. Rev. 42, 33-84.
5. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191, 391-431.
6. Bouret, S., and Sara, S. J. (2004). Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur. J. Neurosci. 20, 791-802.
7. Bouret, S., and Sara, S. J. (2005). Network reset: a simplified overarching theory of locus coeruleus noradrenaline function. Tre n ds Neurosci. 28, 574-582.
8. Bouret, S., Duvel, A., Onat, S., and Sara, S. J. (2003). Phasic activation of locus ceruleus neurons by the central nucleus of the amygdala. J. Neurosci. 23, 3491-3497.
9. Bouret, S., and Richmond, B. J. (2009). Relation of locus coeruleus neurons in monkeys to Pavlovian and oper-ant behaviors. J. Neurophysiol. 101, 898-911.
10. Bouret, S., and Richmond, B. J. (2010). Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J. Neurosci. 30, 8591-8601.
11. Bowman, E. M., Aigner, T. G., and Richmond, B. J. (1996). Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J. Neurophysiol. 75, 1061-1073.
12. Chiba, T., Kayahara, T., and Nakano, K. (2001). Efferent projections of infralimbic and prelimbic areas of the medial prefrontal cortex in the Japanese monkey, Macaca fuscata. Brain Res. 888, 83-101.
13. Collet, C., Dittmar, A., and Vernet-Maury, E. (1999). Programming or inhibiting action: evidence for differential autonomic nervous system response patterns. Int. J. Psychophysiol. 32, 261-276.
14. Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., and Redgrave, P. (2005). How visual stimuli activate dopaminergic neurons at short latency. Science 307, 1476-1479.
15. Doya, K. (2008). Modulators of decision making. Nat. Neurosci. 11, 410-416.
16. Flagel, S., Clark, J., Robinson, T., Mayo, L., Czuj, A., Willuhn, I., Akers, C., Clinton, S., Phillips, P. E. M., and Akil, H. (2011). A selective role for dopamine in stimulus-reward learning. Nature 469, 53-57.
17. Gan, J. O., Walton, M. E., and Phillips, P. E. M. (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 13, 25-27.
18. Hazy, T. E., Frank, M. J., and O'Reilly, R. C. (2010). Neural mechanisms of acquired phasic dopamine responses in learning. Neurosci. Biobehav. Rev. 34, 701-720.
19. La Camera, G., and Richmond, B. J. (2008). Modeling the violation of reward maximization and invari-ance in reinforcement schedules. PLoS Comput. Biol. 4:e1000131. doi: 10.1371/journal.pcbi.1000131
20. Lebreton, M., Jorge, S., Michel, V., Thirion, B., and Pessiglione, M. (2009). An automatic valuation system in the human brain: evidence from functional neuroimag-ing. Neuron 64, 431-439.
21. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
22. McGaughy, J., Ross, R. S., and Eichenbaum, H. (2008). Norad-renergic, but not cholinergic, deafferentation of prefrontal cortex impairs attentional set-shifting. Neuroscience 153, 63-71.
23. Minamimoto, T., Hori, Y., and Kimura, M. (2005). Complementary process to response bias in the cen-tromedian nucleus of the thalamus. Science 308, 1798-1801.
24. Minamimoto, T., Hori, Y., and Kimura, M. (2009). Roles of the thalamic CM-PF complex-Basal ganglia circuit in externally driven rebias of action. Brain Res. Bull. 78, 75-79.
25. Nomoto, K., Schultz, W., Watanabe, T., and Sakagami, M. (2010). Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli. J. Neurosci. 30, 10692-10702.
26. Okada, K.-I., Toyama, K., Inoue, Y., Isa, T., and Kobayashi, Y. (2009). Different pedunculopontine tegmental neurons signal predicted and actual task rewards. J. Neurosci. 29, 4858-4870.
27. Padoa-Schioppa, C., and Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223-226.
28. Pavlov, I. (2003). Conditioned Reflexes. Mineola, NY: Dover Publications.
29. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., and Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442, 1042-1045.
30. Phillips, A. G., Ahn, S., and Howland, J. G. (2003). Amygdalar control of the mesocorticolimbic dopamine system: parallel pathways to motivated behavior. Neurosci. Biobehav. Rev. 27, 543-554.
31. Rajkowski, J., Majczynski, H., Clayton, E. C., and Aston-Jones, G. (2004). Activation of monkey locus coeruleus neurons varies with difficulty and performance in a target detection task. J. Neurophysiol. 92, 361-371.
32. Ravel, S., and Richmond, B. J. (2006). Dopamine neuronal responses in monkeys performing visually cued reward schedules. Eur. J. Neurosci. 24, 277-290.
33. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nat. Rev. Neurosci. 7, 967-975.
34. Robbins, T. W., and Roberts, A. C. (2007). Differential regulation of fronto-executive function by the monoamines and acetylcholine. Cereb. Cortex 17(Suppl. 1), i151-i160.
35. Sara, S. J. (2009). The locus coeruleus and noradrenergic modulation of cognition. Nat. Rev. Neurosci. 10, 211-223.
36. Schultz, W. (2010). Dopamine signals for reward value and risk: basic and recent data. Behav. Brain Funct. 6, 24.
37. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
38. Simmons, J. M., Minamimoto, T., Murray, E. A., and Richmond, B. J. (2010). Selective ablations reveal that orbital and lateral pre-frontal cortex play different roles in estimating predicted reward value. J. Neurosci. 30, 15878-15887.
39. Simmons, J. M., and Richmond, B. J. (2008). Dynamic changes in representations of preceding and upcoming reward in monkey orbitofrontal cortex. Cereb. Cortex 18, 93-103.
40. Slovin, H., Abeles, M., Vaadia, E., Haalman, I., Prut, Y., and Bergman, H. (1999). Frontal cognitive impairments and saccadic deficits in low-dose MPTP-treated monkeys. J. Neurophysiol. 81, 858-874.
41. Ventura, R., Morrone, C., and Puglisi-Allegra, S. (2007). Prefrontal/ accumbal catecholamine system determines motivational salience attribution to both reward- and aversion-related stimuli. Proc. Natl. Acad. Sci. U.S.A. 104, 5181-5186.
42. Wanat, M. J., Kuhnen, C. M., and Phillips, P. E. M. (2010). Delays conferred by escalating costs modulate dopamine release to rewards but not their predictors. J. Neurosci. 30, 12020-12027.
43. Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692.