Prefrontal/accumbal catecholamine system processes high motivational salience

Frontiers in Behavioral Neuroscience

Volumn , Issue JUNE, 2012, Pages

  Puglisi Allegra, Stefano ^a,b   Ventura, Rossella ^b,c  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b IRCCS FONDAZIONE SANTA LUCIA   (Italy)

^c UNIVERSITY OF L'AQUILA   (Italy)

Author keywords

Dopamine; Emotion; Mesoaccumbens; Motivation; Norepinephrine; Prefrontal cortex; Salience

Indexed keywords

CATECHOLAMINE; DOPAMINE; NORADRENALIN;

APPETITIVE RELATED STIMULUS; AVERSION RELATED STIMULUS; AVERSIVE BEHAVIOR; AVOIDANCE BEHAVIOR; CATECHOLAMINE METABOLISM; DOPAMINE RELEASE; DOPAMINERGIC TRANSMISSION; EMOTION; HUMAN; MOTIVATION; MOTIVATIONAL SALIENCE; NONHUMAN; NORADRENALIN RELEASE; NUCLEUS ACCUMBENS; PREFRONTAL CORTEX; REVIEW; REWARD; STIMULUS;

EID: 84864386102     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2012.00031     Document Type: Review

References (184)

1. Adamantidis, A. R., Tsai, H. C., Boutrel, B., Zhang, F., Stuber, G. D., Budygin, A., Tourino, C., Bonci, A., Deisseroth, K., and de Lecea, L. (2011). Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward seeking behavior. J. Neurosci. 1, 10829-10835.
2. Agustin-Pavon, C., Martinez-Ricos, J., Martinez-Garcia, F., and Lanuza, E. (2007). Effects of dopaminergic drugs on innate pheromone-mediated reward in female mice: a new case of dopamine-independent "liking." Behav. Neurosci. 121, 920-932.
3. Ahn, S., and Phillips, A. G. (2002). Modulation by central and basolateral amygdalar nuclei of dopaminergic correlates of feeding to satiety in the rat nucleus accumbens and medial pre-frontal cortex. J. Neurosci. 22, 10958-10965.
4. Ahn, S., and Phillips, A. G. (2003). Independent modulation of basal and feeding-evoked dopamine efflux in the nucleus accumbens and medial prefrontal cortex by the central and basolateral amygdalar nuclei in the rat. Neuroscience 116, 295-305.
5. Anderson, A. K., Wais, P. E., and Gabrieli, J. D. E. (2006). Emotion enhances remembrance of neutral events past. Proc. Natl. Acad. Sci. U.S.A. 103, 1599-1604.
6. Arnold, M. B. (1960). Emotion and Personality. New York, NY: Columbia University Press.
7. Arnsten, A. F. T. (2000). Through the looking glass: differential nora-drenergic modulation of prefrontal cortical function. Neural Plast. 7, 133-146.
8. Arnsten, A. F. T. (2009). Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 10, 410-422.
9. Aston-Jones, G., and Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Ann. Rev. Neurosci. 28, 403-450.
10. Aston-Jones, G., Rajkowski, J., and Cohen, J. (1999). Role of locus coeruleus in attention and behavioral flexibility. Biol. Psychiatry 46, 1309-1320.
11. Balleine, B. W. (2005). Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol. Behav. 86, 717-730.
12. Balleine, B. W., and Killcross, S. (2006). Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci. 29, 272-279.
13. Bardgett, M. E., Depenbrock, M., Downs, N., Points, M., and Green, L. (2009). Dopamine modulates effort-based decision-making in rats. Behav. Neurosci. 123, 242-251.
14. Becerra, L., Breiter, H. C., Wise, R., Gonzalez, R. G., and Borsook, D. (2001). Reward circuitry activation by noxious thermal stimuli. Neuron 32, 927-946.
15. Bechara, A., Harrington, F., Nader, K., and van der Kooy, D. (1992). The neurobiology of motivation: double dissociation of two motivational mechanisms mediating opiate reward in naive versus drug-dependent animals. Behav. Neurosci. 106, 798-807.
16. Belova, M. A., Paton, J. J., Morrison, S. A., and Salzman, D. (2007). Expectation modulates neural responses to pleasant and aver-sive stimuli in primate amygdala. Neuron 55, 970-984.
17. Berridge, C. W., and Waterhouse, B. D. (2003). The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res. Brain Res. Rev. 42, 33-84.
18. Berridge, K. C. (2001). "Reward learning: reinforcement, incentives, and expectations," in The Psychology of Learning and Motivation, Vol. 40, ed D. L. Medin (New York, NY: Academic Press), 223-278.
19. Berridge, K. C. (2004). Motivation concepts in behavioral neuroscience. Physiol. Behav. 81, 179-209.
20. Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28, 309-369.
21. Berridge, K. C., and Valenstein, E. S. (1991). What psychological process mediates feeding evoked by electrical stimulation of the lateral hypothalamus? Behav. Neurosci. 105, 3-14.
22. Berridge, K. C., Venier, I. L., and Robinson, T. E. (1989). Taste reactivity analysis of 6-hydroxydopamine-induced apha-gia: implications for arousal and anhedonia hypotheses of dopamine function. Behav. Neurosci. 103, 36-45.
23. Bindra, D. (1974). A motivational view of learning, performance, and behavior modification. Psychol. Rev. 81, 199-213.
24. Bindra, D. (1978). How adaptive behavior is produced: a perceptual-motivation alternative to response reinforcement. Behav. Brain Sci. 1, 41-91.
25. Bolles, R. C. (1972). Reinforcement, expectancy, and learning. Psychol. Rev. 79, 394-409.
26. Borsook, D., Becerra, L., Carlezon, W. A. Jr., Shaw, M., Renshaw, P., Elman, I., and Levine, J. (2007). Reward-aversion circuitry in analgesia and pain: implications for psychiatric disorders. Eur. J. Pain 11, 7-20.
27. Bouret, S., Duvel, A., Onat, S., and Sara, S. (2003). Phasic activation of locus ceruleus neurons by the central nucleus of the amygdala. J. Neurosci. 23, 3491-3497.
28. Bouret, S., and Sara, S. J. (2004). Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur. J. Neurosci. 20, 791-802.
29. Briand, L., Gritton, H., Howe, W. M., Young, D., and Sarter, M. (2007). Modulators in concert for cognition: modulator interactions in the prefrontal cortex. Prog. Neurobiol. 83, 69-91.
30. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834.
31. Cabib, S., Orsini, C., Le Moal, M., and Piazza, P. V. (2000). Abolition and reversal of strain differences in behavioral responses to drug of abuse after a brief experience. Science 289, 463-465.
32. Cabib, S., and Puglisi-Allegra, S. (2012). The mesoaccumbens dopamine in coping with stress. Neurosci. Biobehav. Rev. 36, 79-89.
33. Caine, S. B., and Koob, G. F. (1993). Modulation of cocaine self-administration in the rat through D-3 dopamine receptors. Science 260, 1814-1816.
34. Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and pre-frontal cortex. Neurosci. Biobehav. Rev. 26, 321-352.
35. Carr, D. B., and Sesack, S. R. (2000). Projections from the rat prefrontal cortex to the ventral tegmental area: target specificity in the synap-tic associations with mesoaccum-bens and mesocortical neurons. J. Neurosci. 20, 3864-3873.
36. Carr, G. D., Fibiger, H., and Phillips, A. G. (1989). "Conditioned place preference as a measure of drug reward," in Oxford Reviews in Psychopharmacology, eds J. M. Leibman and S. J. Cooper (Oxford, UK: Oxford University Press), 264-319.
37. Curtis, A., Bello, N., Connolly, K., and Valentino, R. (2002). Corticotropin-releasing factor neurones of the central nucleus of the amygdala mediate locus coeruleus activation by cardiovascular stress. J. Neuroendocrinol. 14, 667-682.
38. Dalley, J. W., Cardinal, R. N., and Robbins, T. W. (2004). Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 28, 771-784.
39. Dalley, J. W., Mason, K., and Stanford, S. C. (1996). Increased levels of extracellular noradrenaline in the frontal cortex of rats exposed to naturalistic environmental stimuli: modulation by acute systemic administration of diazepam or buspirone. Psychopharmacology (Berl.) 127, 47-54.
40. Dallman, M. F., Pecoraro, N., Akana, S. F., La Fleur, S. E., Gomez, F., Houshyar, H., Bell, M. E., Bhatnagar, S., Laugero, K. D., and Manalo, S. (2003). Chronic stress and obesity: a new view of "comfort food". Proc. Natl. Acad. Sci. U.S.A. 100, 11696-11701.
41. Darracq, L., Blanc, G., Glowinski, J., and Tassin, J. P. (1998). Importance of the noradrenaline-dopamine coupling in the locomotor activating effects of D-amphetamine. J. Neurosci. 18, 2729-2739.
42. Darracq, L., Drouin, C., Blanc, G., Glowinski, J., and Tassin, J. P. (2001). Stimulation of metabotropic but not ionotropic glutamatergic receptors in the nucleus accumbens is required for the D-amphetamine-induced release of functional dopamine. Neuroscience 103, 395-403.
43. Del Arco, A., and Mora, F. (1999). Effects of endogenous glutamate on extracellular concentrations of GABA, dopamine, and dopamine metabolites in the prefrontal cortex of the freely moving rat: involvement of NMDA and AMPA/KA receptors. Neurochem. Res. 24, 1027-1035.
44. Deutch, A. Y., Clark, W. A., and Roth, R. H. (1990). Prefrontal cortical dopamine depletion enhances the responsiveness of mesolimbic dopamine neurons to stress. Brain Res. 521, 311-315.
45. Devoto, P., Flore, G., Pani, L., and Gessa, G. L. (2001). Evidence for co-release of noradrenaline and dopamine from noradrenergic neurons in the cerebral cortex. Mol. Psychiatry 6, 657-664.
46. Devoto, P., Flore, G., Pira, L., Diana, M., and Gessa, G. L. (2002). Co-release of noradrenaline and dopamine in the prefrontal cortex after acute morphine and during morphine withdrawal. Psychopharmacology 160, 220-224.
47. Doherty, M. D., and Gratton, A. (1996). Medial prefrontal cortical D1 receptor modulation of the meso-accumbens dopamine response to stress: an electrochemical study in freely-behaving rats. Brain Res. 715, 86-97.
48. Dworkin, S. I., Guerin, G. F., Co, C., Goeders, N. E., and Smith, J. E. (1988). Lack of an effect of 6-hydroxydopamine lesions of the nucleus accumbens on intravenous morphine self-administration. Pharmacol. Biochem. Behav. 30, 1051-1057.
49. Ettenberg, A., Pettit, H. O., Bloom, F. E., and Koob, G. F. (1982). Heroin and cocaine intravenous self-administration in rats: mediation by separate neural systems. Psychopharmacology 78, 204-209.
50. Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 11, 1481-1487.
51. Feenstra, M. G., Botterblom, M. H., and Mastenbroek, S. (2000). Dopamine and noradrenaline efflux in the prefrontal cortex in the light and dark period: effects of novelty and handling and comparison to the nucleus accumbens. Neuroscience 100, 741-748.
52. Feenstra, M. G., Teske, G., Botterblom, M. H., and de Bruin, J. P. (1999). Dopamine and noradrenaline release in the prefrontal cortex of rats during classical aversive and appetitive conditioning to a contextual stimulus: interference by novelty effects. Neurosci. Lett. 272, 179-182.
53. Feenstra, M. G. P. (2007). "Microdialysis of dopamine and norepinephrine during conditioning and operant behaviour," in Handbook of Microdialysis, vol. 16, eds B. H. C. Westerink and T. I. F. H. Cremers (Amsterdam: Academic Press), 317-350.
54. Fields, H. L., Hjelmstad, G. O., Margolis, E. B., and Nicola, S. M. (2007). Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 30, 289-316.
55. Finlay, J. M., Zigmond, M. J., and Abercrombie, E. D. (1995). Puglisi-Allegra and Ventura Prefrontal/accumbal system and motivational salience Increased dopamine and nore-pinephrine release in medial prefrontal cortex induced by acute and chronic stress: effects of diazepam. Neuroscience 64, 619-628.
56. Floresco, S., West, A., Ash, B., Moore, H., and Grace, A. (2003). Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat. Neurosci. 6, 968-973.
57. Fudge, J. L., and Emiliano, A. B. (2003). The extended amygdala and the dopamine system: another piece of the dopamine puzzle. J. Neuropsychiatry Clin. Neurosci. 15, 306-316.
58. Fudge, J. L., and Haber, S. N. (2000). The central nucleus of the amygdala projection to dopamine subpopula-tions in primates. Neuroscience 97, 479-494.
59. Goldstein, L. E., Rasmusson, A. M., Bunney, B. S., and Roth, R. H. (1996). Role of the amygdala in the coordination of behavioral, neu-roendocrine, and prefrontal cortical monoamine responses to psychological stress in the rat. J. Neurosci. 16, 4787-4798.
60. Gray, J. A., and McNaughton, N. (2000). The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septohippocampal System, 2nd edn. Oxford, UK: Oxford University Press.
61. Grenhoff, J., Nisell, M., Ferre, S., Aston-Jones, G., and Svensson, T. H. (1993). Noradrenergic modulation of midbrain dopamine cell firing elicited by stimulation of the locus coeruleus in the rat. J. Neural Transm. 93, 11-25.
62. Guarnieri, D. J., Brayton, C. E., Richards, S. M., Maldonado-Aviles, J., Trinko, J. R., Nelson, J., Taylor, J. R., Gourley, S. L., and Dileone, R. J. (2011). Gene profiling reveals a role for stress hormones in the molecular and behavioral response to food restriction. Biol. Psychiatry 71, 358-365.
63. Guarraci, F. A., and Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 99, 169-179.
64. Hemby, S. E., Jones, G. H., Justice, J. B. Jr., and Neil, D. B. (1992). Conditioned locomotor activity but not conditioned place preference following intra-accumbens infusions of cocaine. Psychopharmacology 106, 330-336.
65. Hnasko, T. S., Sotak, B. N., and Palmiter, R. D. (2005). Morphine reward in dopamine-deficient mice. Nature 438, 854-857.
66. Holland, P. C., and Gallagher, M. (2004). Amygdala-frontal interactions and reward expectancy. Curr. Opin. Neurobiol. 14, 148-155.
67. Homayoun, H., and Moghaddam, B. (2007). NMDA receptor hypofunction produces opposite effects on prefrontal cortex interneurons and pyrami- dal neurons. J. Neurosci. 27, 11496-11500.
68. Horvitz, J. C. (2000). Mesolimbo cortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96, 651-656.
69. Ikemoto, S. (2007). Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res. Rev. 56, 27-78.
70. Ikemoto, S., and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31, 6-41.
71. Jackson, M. E., and Moghaddam, B. (2001). Amygdala regulation of nucleus accumbens dopamine output is governed by the prefrontal cortex. J. Neurosci. 21, 676-681.
72. Jedema, H., and Grace, A. (2004). Corticotropin-releasing hormone directly activates noradrenergic neurons of the locus ceruleus recorded in vitro. J. Neurosci. 24, 9703-9713.
73. Jedema, H. P., Sved, A. F., Zigmond, M. J., and Finlay, J. M. (1999). Sensitization of norepinephrine release in medial prefrontal cortex: effect of different chronic stress protocols. Brain Res. 830, 211-217.
74. Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., and Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40, 1251-1257.
75. Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland, P. C. (2009). The rostromedial tegmen-tal nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786-800.
76. Jodo, E., Chiang, C., and Aston-Jones, G. (1998). Potent excitatory influence of prefrontal cortex activity on noradrenergic locus coeruleus neurons. Neuroscience 83, 63-79.
77. Joel, D., and Weiner, I. (1997). The connections of the primate subthalamic nucleus: indirect pathways and the open-interconnected scheme of basal ganglia-thalam ocortical circuitry. Brain Res. Rev. 23, 62-78.
78. Joseph, M. H., Datla, K., and Young, A. M. J. (2003). The interpretation of the measurement of nucleus accum-bens dopamine by in vivo dialysis: the kick, the craving or the cognition? Neurosci. Biobehav. Rev. 27, 527-541.
79. Joshua, M., Adler, A., Mitelman, R., Vaadia, E., and Bergman, H. (2008). Midbrain dopaminergic neurons and striatal cholinergic interneu-rons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 28, 11673-11684.
80. Kawahara, Y., Kawahara, H., and Westerink, B. H. (1999). Comparison of effects of hypotension and handling stress on the release of noradrenaline and dopamine in the locus coeruleus and medial prefrontal cortex of the rat. Naunyn Schmiedebergs Arch. Pharmacol. 360, 42-49.
81. Kensinger, E. A., and Schacter, D. L. (2006). Reward circuitry activation by noxious thermal stimuli. J. Neurosci. 26, 2564-2570.
82. Killgore, W. D. S., Young, A. D., Femia, L. A., Bogorodzki, P., Rogowska, J., and Yurgelun-Todd, D. A. (2003). Cortical and limbic activation during viewing of high- versus low-calorie foods. Neuroimage 19, 1381-1394.
83. King, D., Zigmond, M. J., and Finlay, J. M. (1997). Effects of dopamine depletion in the medial prefrontal cortex on the stress-induced increase in extracellular dopamine in the nucleus accumbens core and shell. Neuroscience 77, 141-153.
84. Koob, G. F., and Bloom, F. E. (1988). Cellular and molecular mechanisms of drug dependence. Science 242, 715-723.
85. Lammel, S., Hetzel, A., Hckel, O., Jones, I., Liss, B., and Roeper, J. (2008). Unique properties of meso-prefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 57, 760-773.
86. Lammel, S., Ion, D. I., Roeper, J., and Malenka, R. C. (2011). Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 70, 855-862.
87. Lapiz, M. D. S., and Morilak, D. A. (2006). Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability. Neuroscience 32, 1000-1010.
88. Laviolette, S. R., Gallegos, R. A., Henriksen, S. J., and van der Kooy, D. (2004). Opiate state controls bi-directional reward signaling via GABAA receptors in the ventral tegmental area. Nat. Neurosci. 7, 160-169.
89. Lazarus, R. S. (1991). Cognition and motivation in emotion. Am. Psychol. 46, 352-367.
90. Le Moal, M., and Simon, H. (1991). Mesocorticolimbic dopaminergic network: functional and regulatory role. Physiol. Rev. 71, 155-234.
91. Lewis, B. L., and O'Donnell, P. (2000). Ventral tegmental area afferents to the prefrontal cortex maintain membrane potential 'up' states in pyramidal neurons via d(1) dopamine receptors. Cereb. Cortex 10, 1168-1175.
92. Liprando, L. A., Miner, L. H., Blakely, R. D., Lewis, D. A., and Sesack, S. R. (2004). Ultrastructural interactions between terminals expressing the norepinephrine transporter and dopamine neurons in the rat and monkey ventral tegmental area. Synapse 52, 233-244.
93. Lu, L., Shepard, J. D., Scott Hall, F., and Shaham, Y. (2003). Effect of environmental stressors on opiate and psychostimulant reinforcement, reinstatement and discrimination in rats: a review. Neurosci. Biobehav. Rev. 27, 457-491.
94. Lupinsky, D., Moquin, L., and Gratton, A. (2010). Interhemispheric regulation of the medial prefrontal cortical glutamate stress response in rats. J. Neurosci. 30, 7624-7633.
95. Mackey, W. B., and van der Kooy, D. (1985). Neuroleptics block the positive reinforcing effects of amphetamine but not morphine as measured by place conditioning. Pharmacol. Biochem. Behav. 22, 101-105.
96. Mahler, S. V., and Berridge, K. C. (2011). What and when to "want"? Amygdala-based focusing of incentive salience upon sugar and sex. Psychopharmacology (Berl.) 221, 407-426.
97. Margolis, E. B., Lock, H., Chefer, V. I., Shippenberg, T. S., Hjelmstad, G. O., and Fields, H. L. (2006). Kappa opioids selectively control dopaminergic neurons projecting to the prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 103, 2938-2942.
98. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
99. McGaugh, J. L. (2005). Emotional arousal and enhanced amygdala activity: new evidence for the Puglisi-Allegra and Ventura Prefrontal/accumbal system and motivational salience old perseveration-consolidation hypothesis. Learn. Mem. 12, 77-79.
100. McGaugh, J. L. (2006). Make mild moments memorable: add a little arousal. Trends Cogn. Sci. 10, 345-347.
101. McQuade, R., Creton, D., and Stanford, S. C. (1999). Effect of novel environmental stimuli on rat behavior and central noradrenaline function measured by in vivo microdialysis. Psychopharmacology 145, 393-400.
102. Mingote, S., de Bruin, J. P. C., and Feesntra, M. G. P. (2004). Noradrenaline and dopamine afflux in the prefrontal cortex in relation to appetitive classical conditioning. J. Neurosci. 24, 2475-2480.
103. Morilak, D. A., Barrera, G., Echevarria, D. J., Garcia, A. S., Hernandez, A., Ma, S., and Petre, C. O. (2005). Role of brain norepinephrine in the behavioral response to stress. Prog. Neuropsychopharmacol. Biol. Psychiatry 29, 1214-1224.
104. Moron, J. A., Brockington, A., Wise, R. A., Rocha, B. A., and Hope, B. T. (2002). Dopamine uptake through the norepinephrine transporter in brain regions with low levels of the dopamine transporter: evidence from knock-out mouse lines. J. Neurosci. 22, 389-395.
105. Mucha, R. F., and Iversen, S. D. (1984). Reinforcing properties of morphine and naloxone revealed by conditioned place preferences: a procedural examination. Psychopharmacology 82, 241-247.
106. Mueller, D., and Stewart, J. (2000). Cocaine-induced conditioned place preference: reinstatement by priming injections of cocaine after extinction. Behav. Brain. Res. 115, 39-47.
107. Nader, K., Bechara, A., and van der Kooy, D. (1997). Neurobiological constraints of behavioral models of motivation. Annu. Rev. Psychol. 48, 85-114.
108. Nader, K., Harrington, F., Bechara, A., and van der Kooy, D. (1994). Neuroleptics block high but not low dose heroin place preferences: further evidence for a two system model of motivation. Behav. Neurosci. 108, 1128-1138.
109. Naranjo, C. A., Tremblay, L. K., and Busto, U. E. (2001). The role of the brain reward system in depression. Prog. Neuropsychopharmacol. Biol. Psychiatry 25, 781-823.
110. Nicniocaill, B., and Gratton, A. (2007). Medial prefrontal cortical alpha1 adrenoreceptor modulation of the nucleus accumbens dopamine response to stress in Long-Evans rats. Psychopharmacology (Berl.) 191, 835-842.
111. Niv, Y., Joel, D., and Dayan, P. (2006). A normative perspective on motivation. Trends Cogn. Sci. 10, 375-381.
112. O'Doherty, J., Kringerlbach, M. L., Rolls, R. T., Hornak, J., and Andrews, C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102.
113. Page, M. E., and Lucki, I. (2002). Effects of acute and chronic rebox-etine treatment on stress-induced monoamine efflux in the rat frontal cortex. Neuropsychopharmacology 27, 237-247.
114. Palmiter, R. D. (2008). Dopamine signaling in the dorsal striatum is essential for motivated behaviors: lessons from dopamine-deficient mice. Ann. N.Y. Acad. Sci. 1129, 35-46.
115. Panksepp, J. (1998). Affective Neuroscience: The Foundations of Human and Animal Emotions. Oxford, UK: Oxford University Press.
116. Pascucci, T., Ventura, R., Latagliata, E. C., Cabib, S., and Puglisi-Allegra, S. (2007). The medial prefrontal cortex determines the accum-bens dopamine response to stress through the opposing influences of norepinephrine and dopamine. Cereb. Cortex 17, 2796-2804.
117. Pecina, S., Berridge, K. C., and Parker, L. A. (1997). Pimozide does not shift palatability: separation of anhedonia from sensorimotor suppression by taste reactivity. Pharmacol. Biochem. Behav. 58, 801-811.
118. Pecina, S., Schulkin, J., and Berridge, K. C. (2006). Nucleus accumbens corticotropin releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress? BMC Biol. 13, 8.
119. Pettit, H. O., Ettenberg, A., Bloom, F. E., and Koob, G. F. (1984). Destruction of dopamine in the nucleus accum-bens selectively attenuates cocaine but not heroin self-administration in rats. Psychopharmacology 84, 167-173.
120. Phillips, A. G., Ahn, S., and Howland, J. G. (2003a). Amygdalar control of the mesocorticolimbic dopamine system: parallel pathways to motivated behavior. Neurosci. Biobehav. Rev. 27, 543-554.
121. Phillips, M. L., Drevets, W. C., Rauch, S. L., and Lane, R. (2003b). Neurobiology of emotion perception I: the neural basis of normal emotion perception. Biol. Psychiatry 54, 504-514.
122. Phillips, P. E. M., Walton, M. E., and Jhou, T. C. (2007). Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology 191, 483-495.
123. Piazza, P. V., and Le Moal, M. (1997). Glucocorticoids as a biological substrate of reward: physiological and pathophysiological implications. Brain Res. Rev. 25, 359-372.
124. Pierce, R. C., and Kumaresan, V. (2006). The mesolimbic dopamine system: the final common pathway for the reinforcing effect of drugs of abuse? Neurosci. Biobehav. Rev. 30, 215-238.
125. Ramos, B. P., and Arnsten, A. F. (2007). Adrenergic pharmacology and cognition: focus on the prefrontal cortex. Pharmacol. Ther. 113, 523-536.
126. Rassnick, S., Stinus, L., and Koob, G. F. (1993). The effects of 6-hydroxydopamine lesions of the nucleus accumbens and the mesolimbic dopamine system on oral self-administration of ethanol in the rat. Brain Res. 623, 16-24.
127. Richard, J. M., and Berridge, K. C. (2011). Nucleus accumbens dopamine/glutamate interaction switches modes to generate desire versus dread: D(1) alone for appetitive eating but D(1) and D(2) together for fear. J. Neurosci. 31, 12866-12879.
128. Robbins, T. W. (2000). Chemical neu-romodulation of frontal-executive functions in humans and other animals. Exp. Brain Res. 133, 130-138.
129. Robinson, T. E., and Berridge, K. C. (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain. Res. Rev. 18, 247-291.
130. Robinson, T. E., and Berridge, K. C. (2003). Addiction. Annu. Rev. Psychol. 54, 25-53.
131. Robbins, T. W., and Arnsten, A. F. (2009). The neuropsychopharma-cology of fronto-executive function: monoaminergic modulation. Annu. Rev. Neurosci. 32, 267-287.
132. Rolls, E. T. (2000). Précis of the brain and emotion. Behav. Brain Sci. 23, 177-191.
133. Roozendaal, B. (2000). Glucocorticoids and the regulation of memory consolidation. Psycho neuroendocrinology 25, 213-238.
134. Roozendaal, B., McReynolds, J. R., and McGaugh, J. L. (2004). The basolateral amygdala interacts with the medial prefrontal cortex in regulating glucocorticoid effects on working memory impairment. J. Neurosci. 24, 1385-1392.
135. Rossetti, Z. L., and Carboni, S. (2005). Noradrenaline and dopamine elevations in the rat prefrontal cortex in spatial working memory. J. Neurosci. 25, 2322-2329.
136. Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191, 461-482.
137. Salamone, J. D., Correa, M., Mingote, S. M., and Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34-41.
138. Salzman, D. C., and Fusi, S. (2010). Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33, 173-202.
139. Sara, S. J., and Segal, M. (1991). Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: implications for cognition. Prog. Brain. Res. 88, 571-585.
140. Schultz, W. (2007). Behavioral dopamine signals. Trends Neuro sci. 30, 203-210.
141. Sesack, S. R., and Pickel, V. M. (1990). Prefrontal cortical efferents in the rat synapse on unlabeled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area. Brain Res. 506, 166-168.
142. Sesack, S. R., and Pickel, V. M. (1992). Prefrontal cortical efferents in the rat synapse on unlabeled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area. J. Comp. Neurol. 320, 145-160.
143. Setlow, B., Roozendaal, B., and McGaugh, J. L. (2000). Involvement of a basolateral amygdala complex-nucleus accumbens pathway in glucocorticoid-induced modulation of memory consolidation. Eur. J. Neurosci. 12, 367-375.
144. Seymour, B., and Dolan, R. (2008). Emotion, decision-making, and the amygdala. Neuron 58, 662-671.
145. Shaham, Y., Shalev, U., Lu, L., de Wit, H., and Stewart, J. (2003). The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology 168, 3-20.
146. Shi, W. X., Pun, C. L., Zhang, X. X., Jones, M. D., and Bunney, B. S. (2000). Dual effects of D-amphetamine on dopamine neurons mediated by dopamine and nondopamine receptors. J. Neurosci. 20, 3504-3511.
147. Shippenberg, T. S., and Herz, A. (1988). Motivational effects of opioids: influence of D1 versus D2 receptor antagonists. Eur. J. Pharmacol. 151, 233-242.
148. Skinner, B. F. (1953). Science and Human Behavior. New York, NY: Macmillan.
149. Small, D. M., Zatorre, R. J., Dagher, A., Evans, A. C., and Jones-Gotman, M. (2001). Changes in brain activity related to eating: from pleasure to aversion. Brain 124, 1720-1733.
150. Spyraki, C., Fibiger, H. C., and Phillips, A. G. (1982). Cocaine-induced place preference conditioning: lack of effects of neuroleptics and 6-hydroxydopamine lesions. Brain Res. 253, 195-203.
151. Sturgess, J. E., Ting-A-Kee, R. A., Podbielski, D., Sellings, L. H., Chen, J. F., and van der Kooy, D. (2010). Adenosine A1 and A2A receptors are not upstream of caffeine's dopamine D2 receptor-dependent aversive effects and dopamine-independent rewarding effects. Eur. J. Neurosci. 32, 143-154.
152. Taber, M. T., and Fibiger, H. C. (1995). Electrical stimulation of the pre-frontal cortex increases dopamine release in the nucleus accum-bens of the rat: modulation by metabotropic glutamate receptors. J. Neurosci. 15, 3896-3904.
153. Tanda, G., Pontieri, F. E., Frau, R., and Di Chiara, G. (1997). Contribution of blockade of the noradrenaline carrier to the increase of extracellular dopamine in the rat prefrontal cortex by amphetamine and cocaine. Eur. J. Neurosci. 9, 2077-2085.
154. Tassin, J. P. (1998). Norepinephrine-dopamine interactions in the pre-frontal cortex and the ventral tegmental area: relevance to mental diseases. Adv. Pharmacol. 42, 712-716.
155. Tierney, P. L., Thierry, A. M., Glowinski, J., Deniau, J. M., and Gioanni, Y. (2008). Dopamine modulates temporal dynamics of feedforward inhibition in rat prefrontal cortex in vivo. Cereb. Cortex 18, 2251-2262.
156. Ting-A-Kee, R., Dockstader, C., Heinmiller, A., Grieder, T., and van der Kooy, D. (2009). GABA(A) receptors mediate the opposing roles of dopamine and the tegmen-tal pedunculopontine nucleus in the motivational effects of ethanol. Eur. J. Neurosci. 29, 1235-1244.
157. Toates, F. (1986). Motivational Systems. Cambridge, MA: Cambridge University Press.
158. Toates, F. M. (1994). "Comparing motivational systems-an incentive motivation perspective," in Appetite: Neural and Behavioural Bases, eds C. R. Legg and D. A. Booth (New York, NY: Oxford University Press), 305-327.
159. Tronel, S., Feenstra, M. G., and Sara, S. J. (2004). Noradrenergic action in prefrontal cortex in the late stage of memory consolidation. Learn. Mem. 11, 453-458.
160. Tsai, H. C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., and Deisseroth, K. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080-1083.
161. Tzschentke, T. M. (1998). Measuring reward with the conditioned place preference paradigm: a comprehensive review of drug effects, recent progress and new issues. Prog. Neurobiol. 56, 613-672.
162. Ungless, M. A., Magill, P. J., and Bolam, J. P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303, 2040-2042.
163. Valentino, R., and van Bockstaele, E. (2001). Opposing regulation of the locus coeruleus by corticotropin-releasing factor and opioids. potential for reciprocal interactions between stress and opioid sensitivity. Psychopharmacology 158, 331-342.
164. Van Bockstaele, E., Bajic, D., Proudfit, H., and Valentino, R. (2001). Topographic architecture of stress-related pathways targeting the nora-drenergic locus coeruleus. Physiol. Behav. 73, 273-283.
165. van der Kooy, D. (1987). "Place conditioning: a simple and effective method for assessing the motivational properties of drugs," in Methods of Assessing the Reinforcing Properties of Drugs of Abuse, ed M. A. Bozarth (New York, NY: Springer-Verlag), 229-240.
166. van der Meulen, J. A., Joosten, R. N., de Bruin, J. P., and Feenstra, M. G. (2007). Dopamine and nora-drenaline efflux in the medial pre-frontal cortex during serial reversals and extinction of instrumental goal-directed behavior. Cereb. Cortex 17, 1444-1453.
167. Vargas-Perez, H., Ting-A-Kee, R., Walton, C. H., Hansen, D. M., Razavi, R., Clarke, L., Bufalino, M. R., Allison, D. W., Steffensen, S. C., and van der Kooy, D. (2009). Ventral Tegmental Area BDNF induces an opiate-dependent-like renard state in naive rats. Science 324, 1732-1734.
168. Ventura, R., Alcaro, A., Cabib, S., Conversi, D., Mandolesi, L., and Puglisi-Allegra, S. (2004). Dopamine in the medial prefrontal cortex controls genotype-dependent effects of amphetamine on mesoaccumbens dopamine release and locomotion. Neuropsychopharmacology 29, 72-80.
169. Ventura, R., Alcaro, A., and Puglisi-Allegra, S. (2005). Prefrontal cortical norepinephrine release is critical for morphine-induced reward, reinstatement and dopamine release in the nucleus accumbens. Cereb. Cortex 15, 1877-1886.
170. Ventura, R., Cabib, S., Alcaro, A., Orsini, C., and Puglisi-Allegra, S. (2003). Norepinephrine in the prefrontal cortex is critical for amphetamine-induced reward and mesoaccumbens dopamine release. J. Neurosci. 23, 1879-1885.
171. Ventura, R., Cabib, S., and Puglisi-Allegra, S. (2001). Opposite genotype-dependent mesocorticol-imbic dopamine response to stress. Neuroscience 104, 627-633.
172. Ventura, R., Cabib, S., and Puglisi-Allegra, S. (2002). Genetic susceptibility of mesocortical dopamine to stress determines liability to inhibition of mesoac-cumbens dopamine and to behavioral 'despair' in a mouse model of depression. Neuroscience 115, 999-1007.
173. Ventura, R., de Carolis, D., Alcaro, A., and Puglisi-Allegra, S. (2006). Ethanol consumption and reward depend on norepinephrine in the prefrontal cortex. Neuroreport 17, 1813-1817.
174. Ventura, R., Latagliata, E. C., Morrone, C., La Mela, I., and Puglisi-Allegra, S. (2008). Prefrontal norepinephrine determines attribution of "high" motivational salience. PLoS ONE. 3:3044. doi: 10.1371/ journal.pone.0003044
175. Ventura, R., Morrone, C., and Puglisi-Allegra, S. (2007). Prefrontal/ accumbal catecholamine system determines motivational salience attribution to both reward-and aversion-related stimuli. Proc. Natl. Acad. Sci. U.S.A. 104, 5181-5186.
176. Wang, D. V., and Tsien, J. Z. (2011). Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS ONE 6:e17047. doi: 10.1371/journal.pone.0017047
177. Wang, G.-J., Volkow, N. D., Thanos, P. K., and Fowler, J. S. (2004). Similarity between obesity and drug addiction as assessed by neurofunctional imaging: a concept review. J. Addict. Dis. 23, 9-53.
178. Wise, R. A. (1996). Addictive drugs and brain stimulation reward. Annu. Rev. Neurosci. 19, 319-340.
179. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
180. Womer, D. E., Jones, B. C., and Erwin, V. G. (1994). Characterization of dopamine transporter and locomo-tor effects of cocaine, GBR 12909, epidepride, and SCH 23390 in C57BL and DBA mice. Pharmacol. Biochem. Behav. 48, 327-335.
181. Zink, C. F., Pagnoni, G., Chappelow, J., Martin-Skurski, M., and Berns, G. S. (2006). Human striatal activation reflects degree of stimulus saliency. Neuroimage 29, 977-983.
182. Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., and Berns, G. S. (2003). Human striatal sesponse to salient nonrewarding stimuli. J. Neurosci. 23, 8092-8097.
183. Zocchi, A., Orsini, C., Cabib, S., and Puglisi-Allegra, S. (1998). Parallel strain-dependent effect of amphetamine on locomotor activity and dopamine release in the nucleus accumbens: an in vivo study in mice. Neuroscience 82, 521-528.
184. Zorawski, M., and Killcross, S. (2002). Posttraining glucocorticoid receptor agonistenhances memory in appetitive and aversive pavlo-vian discrete-cue conditioning paradigms. Neurobiol. Learn. Mem. 78, 458-464.