Noradrenaline and dopamine neurons in the reward/effort trade-off: A direct electrophysiological comparison in behaving monkeys

Journal of Neuroscience

Volumn 35, Issue 20, 2015, Pages 7866-7877

  Varazzani, Chiara ^a,b   San Galli, Aurore ^a   Gilardeau, Sophie ^c   Bouret, Sebastien ^a  

^a INSTITUT DU CERVEAU ET DE LA MOELLE ÉPINIÈRE   (France)

^b Service de Gastroentérologie Pédiatrique   (France)

^c IHU A ICM Paris Institute of Translational Neurosciences   (France)

Author keywords

Choice; Decision; Locus coeruleus; Motivation; Pupil; Substantia nigra

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; DECISION MAKING; DOPAMINERGIC NERVE CELL; ELECTROPHYSIOLOGY; LOCUS CERULEUS; MALE; NONHUMAN; NORADRENERGIC NERVE CELL; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; SINGLE UNIT ACTIVITY; SPIKE WAVE; SUBSTANTIA NIGRA; TASK PERFORMANCE; VISUAL STIMULATION; ADRENERGIC NERVE CELL; ANIMAL; CYTOLOGY; EYE MOVEMENT; PHYSIOLOGY; PUPIL;

ADRENERGIC NEURONS; ANIMALS; DECISION MAKING; DOPAMINERGIC NEURONS; EYE MOVEMENTS; LOCUS COERULEUS; MACACA MULATTA; MALE; PUPIL; REWARD; SUBSTANTIA NIGRA;

EID: 84929698394     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0454-15.2015     Document Type: Article

References (61)

1. Abercrombie ED, Jacobs BL (1987) Single-unit response of noradrenergic neurons in the locus coeruleus of freely moving cats. I. Acutely presented stressful and nonstressful stimuli. J Neurosci 7:2837-2843. Medline
2. Acevedo EO, Kraemer RR, Kamimori GH, Durand RJ, Johnson LG, Castracane VD (2007) Stress hormones, effort sense, and perceptions of stress during incremental exercise: an exploratory investigation. J Strength Cond Res 21:283-288.CrossRef Medline
3. Aebischer P, Schultz W (1984) The activity of pars compacta neurons of the monkey substantia nigra is depressed by apomorphine. Neurosci Lett 50:25-29.CrossRef Medline
4. Arnsten AF (2000) Through the looking glass: differential noradenergic modulation of prefrontal cortical function. Neural Plast 7:133-146.CrossRef Medline
5. Aston-Jones G, Cohen JD (2005) An integrative theory of locus coeruleusnorepinephrine function: adaptive gain and optimal performance. Annu Rev Neurosci 28:403-450.CrossRef Medline
6. Aston-Jones G, Shipley MT, Chouvet G, Ennis M, van Bockstaele E, Pieribone VA, Shiekhattar R, Akaoka H, Drolet G, Astier B (1991) Afferent regulation of locus coeruleus neurons: anatomy, physiology and pharmacology. Prog Brain Res 88:47-75.CrossRef Medline
7. Aston-Jones G, Rajkowski J, Kubiak P, Alexinsky T (1994) Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task. J Neurosci 14:4467-4480. Medline
8. Aston-Jones G, Rajkowski J, Kubiak P, Valentino RJ, Shipley MT (1996) Role of the locus coeruleus in emotional activation. Prog Brain Res 107: 379-402.CrossRef Medline
9. Berridge CW, Waterhouse BD (2003) The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res Brain Res Rev 42:33-84.CrossRef Medline
10. Berridge KC (2007) The debate over dopamine’s role in reward: the case for incentive salience. Psychopharmacology 191:391-431.CrossRef Medline
11. Bouret S, Richmond BJ (2009) Relation of locus coeruleus neurons in monkeys to Pavlovian and operant behaviors. J Neurophysiol 101:898-911.
12. Medline Bouret S, Richmond BJ (2010) Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J Neurosci 30:8591-8601.CrossRef Medline
13. Bouret S, Richmond BJ (2015) Sensitivity of locus coeruleus neurons to reward and goal directed actions. J Neurosci 35:4005-4014.CrossRef Medline
14. Bouret S, Sara SJ (2004) Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur J Neurosci 20:791-802.CrossRef Medline
15. Bouret S, Sara SJ (2005) Network reset: a simplified overarching theory of locus coeruleus noradrenaline function. Trends Neurosci 28:574-582.CrossRef Medline
16. Bouret S, Ravel S, Richmond BJ (2012) Complementary neural correlates of motivation in dopaminergic and noradrenergic neurons of monkeys. Front Behav Neurosci 6:40. Medline
17. Bromberg-Martin ES, Matsumoto M, Hikosaka O (2010) Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68:815-834.CrossRef Medline
18. Clayton EC, Rajkowski J, Cohen JD, Aston-Jones G (2004) Phasic activation of monkey locus ceruleus neurons by simple decisions in a forced-choice task. J Neurosci 24:9914-9920.CrossRef Medline
19. Collet C, Roure R, Rada H, Dittmar A, Vernet-Maury E (1996) Relationships between performance and skin resistance evolution involving various motor skills. Physiol Behav 59:953-963.CrossRef Medline
20. Croxson PL, Walton ME, O’Reilly JX, Behrens TE, Rushworth MF (2009) Effort-based cost-benefit valuation and the human brain. J Neurosci 29: 4531-4541.CrossRef Medline
21. Day JJ, Jones JL, Wightman RM, Carelli RM (2010) Phasic nucleus accumbens dopamine release encodes effort-and delay-related costs. Biol Psychiatry 68:306-309.CrossRef Medline
22. Doya K (2008) Modulators of decision making. Nat Neurosci 11:410-416.CrossRef Medline
23. Foote SL, Aston-Jones G, Bloom FE (1980) Impulse activity of locus coeruleus neurons in awake rats and monkeys is a function of sensory stimulation and arousal. Proc Natl Acad Sci U S A 77:3033-3037.CrossRef Medline
24. Gan JO, Walton ME, Phillips PE (2010) Dissociable cost and benefit encod-ing of future rewards by mesolimbic dopamine. Nat Neurosci 13:25-27.CrossRef Medline
25. Glenn LL, Steriade M (1982) Discharge rate and excitability projecting intralaminar thalamic waking and sleep states. J Neurosci 2:1387-1404. Medline
26. Grant SJ, Aston-Jones G, Redmond DE Jr (1988) Responses of primate locus coeruleus neurons to simple and complex sensory stimuli. Brain Res Bull 21:401-410.CrossRef Medline
27. Haber SN (2003) The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat 26:317-330.CrossRef Medline
28. Haber SN, Knutson B (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35:4-26. Medline
29. Heilbronner SR, Platt ML (2013) Causal evidence of performance monitoring by neurons in posterior cingulate cortex during learning. Neuron 80:1384-1391.CrossRef Medline
30. Hosking JG, Floresco SB, Winstanley CA (2015) Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision making tasks. Neuropsychopharmacology 40:1005-1015. Medline
31. Hosokawa T, Kennerley SW, Sloan J, Wallis JD (2013) Single-neuron mechanisms underlying cost-benefit analysis in frontal cortex. J Neurosci 33: 17385-17397.CrossRef Medline
32. Howells FM, Stein DJ, Russell VA (2010) Perceived mental effort correlates with changes in tonic arousal during attentional tasks. Behav Brain Funct 6:39.CrossRef Medline
33. Kahneman D, Beatty J (1966) Pupil diameter and load on memory. Science 154:1583-1585.CrossRef Medline
34. Kalwani RM, Joshi S, Gold JI (2014) Phasic activation of individual neurons in the locus ceruleus/subceruleus complex of monkeys reflects rewarded decisions to go but not stop. J Neurosci 34:13656-13669.CrossRef Medline
35. Kupalov PS (1961) Some normal and pathological properties of nervous processes in the brain. Ann N Y Acad Sci 92:1046-1053. Medline
36. Kurniawan IT, Guitart-Masip M, Dayan P, Dolan RJ (2013) Effort and valuation in the brain: the effects of anticipation and execution. J Neurosci 33:6160-6169.CrossRef Medline
37. Lak A, Stauffer WR, Schultz W (2014) Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc Natl Acad Sci U S A 111:2343-2348.CrossRef Medline
38. Massaro L, Liu Q, Visalberghi E, Fragaszy D (2012) Wild bearded capuchin (Sapajus libidinosus) select hammer tools on the basis of both stone mass and distance from the anvil. Anim Cogn 15:1065-1074.CrossRef Medline
39. Meyniel F, Sergent C, Rigoux L, Daunizeau J, Pessiglione M (2013) Neurocomputational account of how the human brain decides when to have a break. Proc Natl Acad Sci U S A 110:2641-2646.CrossRef Medline
40. Minamimoto T, Kimura M (2002) Participation of the thalamic CM-Pf complex in attentional orienting. J Neurophysiol 87:3090-4101. Medline
41. Minamimoto T, Hori Y, Kimura M (2005) Complementary process to response bias in the centromedian nucleus of the thalamus. Science 308: 1798-1801.CrossRef Medline
42. Minamimoto T, Hori Y, Kimura M (2009a) Roles of the thalamic CM-PF complex-basal ganglia circuit in externally driven rebias of action. Brain Res Bull 78:75-79.CrossRef Medline
43. Minamimoto T, La Camera G, Richmond BJ (2009b) Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys. J Neurophysiol 101:437-447. Medline
44. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H (2006) Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 9:1057-1063.CrossRef Medline
45. Parvizi J, Rangarajan V, Shirer WR, Desai N, Greicius MD (2013) The will to persevere induced by electrical stimulation of the human cingulate gyrus. Neuron 80:1359-1367.CrossRef Medline
46. Pasquereau B, Turner RS (2013) Limited encoding of effort by dopamine neurons in a cost-benefit trade-off task. J Neurosci 33:8288-8300.CrossRef Medline
47. Phillips PE, Walton ME, Jhou TC (2007) Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology 191:483-495.CrossRef Medline
48. Prèvost C, Pessiglione M, Mètèreau E, Clèry-Melin ML, Dreher JC (2010) Separate valuation subsystems for delay and effort decision costs. J Neurosci 30:14080-14090.CrossRef Medline
49. Salamone JD, Correa M (2012) The mysterious motivational functions of mesolimbic dopamine. Neuron 76:470-485.CrossRef Medline
50. Sara SJ, Bouret S (2012) Orienting and reorienting: the locus coeruleus mediates cognition through arousal. Neuron 76:130-141.CrossRef Medline
51. Sara SJ, Segal M (1991) Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: implications for cognition. Prog Brain Res 88:571-585.CrossRef Medline
52. Schmidt L, Clèry-Melin M-L, Lafargue G, Valabrègue R, Fossati P, Dubois B, Pessiglione M (2009) Get aroused and be stronger: emotional facilitation of physical effort in the human brain. J Neurosci 29:9450-9457.CrossRef Medline
53. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.CrossRef Medline
54. Steiner GZ, Barry RJ (2011) Pupillary responses and event-related potentials as indices of the orienting reflex. Psychophysiology 48:1648-1655.CrossRef Medline
55. Ventura R, Latagliata EC, Morrone C, La Mela I, Puglisi-Allegra S (2008) Prefrontal norepinephrine determines attribution of “high” motivational salience. PLoS One 3:e3044.CrossRef Medline
56. Walton ME, Bannerman DM, Rushworth MF (2002) The role of rat medial frontal cortex in effort-based decision making. J Neurosci 22:10996-11003. Medline
57. Walton ME, Bannerman DM, Alterescu K, Rushworth MF (2003) Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J Neurosci 23:6475-6479. Medline
58. Walton ME, Groves J, Jennings KA, Croxson PL, Sharp T, Rushworth MF, Bannerman DM (2009) Comparing the role of the anterior cingulate cortex and 6-hydroxydopamine nucleus accumbens lesions on operant effort-based decision making. Eur J Neurosci 29:1678-1691.CrossRef Medline
59. Waterhouse BD, Moises HC, Woodward DJ (1998) Phasic activation of the locus coeruleus enhances responses of primary sensory cortical neurons to peripheral receptive field stimulation. Brain Res 790:33-44.CrossRef Medline
60. Webb HE, McMinn DR, Garten RS, Beckman JL, Kamimori GH, Acevedo EO (2010) Cardiorespiratory responses of firefighters to a computerized fire strategies and tactics drill during physical activity. Applied Ergonomics 41:376-381.CrossRef Medline
61. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681-692.CrossRef Medline