Dopamine, behavioral economics, and effort

Frontiers in Behavioral Neuroscience

Volumn 3, Issue SEP, 2009, Pages

  Salamone, John D ^a   Correa, Merce ^a,b   Farrar, Andrew M ^a   Nunes, Eric J ^a   Pardo, Marta ^a,b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b UNIVERSITAT JAUME I   (Spain)

Author keywords

Activation; Anergia; Depression; Motivation; Nucleus accumbens; Psychomotor slowing; Reinforcement; Reward

Indexed keywords

EID: 70349116413     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.08.013.2009     Document Type: Review

References (173)

1. Aberman, J. E., and Salamone, J. D. (1999). Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92, 545-552.
2. Allison, J. (1981). Economics and operant conditioning. In Predictability, Correlation and Contiguity, P. Harzem and M. D. Zeiler, eds (New York, John Wiley and Sons), pp 321-353.
3. Allison, J. (1993). Response deprivation, reinforcement, and economics. J. Exp. Anal. Behav. 60, 129-140.
4. Anstrom, K. K., and Woodward, D. J. (2005). Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology 30, 1832-1840.
5. Aparicio, C. F. (2001). Overmatching in rats: the barrier choice paradigm. J. Exp. Anal. Behav. 75:93-106.
6. Aparicio, C. F. (2007). Haloperidol, dynamics of choice, and the parameters of the matching law. Behav. Processes 75, 206-212.
7. Bakshi, V. P., and Kelley, A. E. (1991). Dopaminergic regulation of feeding behavior: I. Differential effects of haloperidol microinjection in three striatal subregions. Psychobiology 19, 223-232.
8. Baldo, B. A., and Kelley, A. E. (2007). Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding. Psychopharmacology (Berl.) 191, 439-459.
9. Baldo, B. A., Sadeghian, K., Basso, A. M., and Kelley, A. E. (2002). Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on ingestive behavior and associated motor activity. Behav. Brain Res. 137, 165-177.
10. Barbano, M. F., and Cador, M. (2007). Opioids for hedonic experience and dopamine to get ready for it. Psychopharmacology 191, 497-506.
11. Bardgett, M. E., Depenbrock, M., Downs, N., Points, M., and Green, L. (2009). Dopamine modulates effortbased decision making in rats. Behav. Neurosci. 123, 242-251.
12. Barraco, R. A., Martens, K. A., Parizon, M., and Normile, H. J. (1993). Adenosine A2a receptors in the nucleus accumbens mediate locomotor depression. Brain Res. Bull. 31, 397-404.
13. Baum, W. M. (1974). On two types of deviation from the matching law: bias and undermatching. J. Exp. Anal. Behav. 22, 231-242.
14. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191, 391-431.
15. Berridge, K. C., and Kringlebach, M. L. (2008). Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology 199, 457-480.
16. Bickel, W. K., Marsch, L. A., and Carroll, M. E. (2000). Deconstructing relative reinforcing efficacy and situating the measures of pharmacological reinforcement with behavioral economics: a theoretical proposal. Psychopharmacology 153, 44-56.
17. Blazquez, P. M., Fujii, N., Kojima, J., and Graybiel, A. M. (2002). A network representation of response probability in the striatum. Neuron 33, 973-982.
18. Brauer, L. H., and De Wit, H. (1997). High dose pimozide does not block amphetamine-induced euphoria in normal volunteers. Pharmacol. Biochem. Behav. 56, 265-272.
19. Brischoux, F., Chakraborty, S., Brierley, D. I., and Ungless, M. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. USA 106, 4894-4899.
20. Broom, S. L., and Yamamoto, B. K. (2005). Effects of subchronic methamphetamine exposure on basal dopamine and stress-induced dopamine release in the nucleus accumbens shell of rats. Psychopharmacology 181, 467-476.
21. Cagniard, B., Balsam, P. D., Brunner, D., and Zhuang, X. (2006). Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology 31, 1362-1370.
22. Cannon, C. M., and Bseikri, M. R. (2004). Is dopamine required for natural reward? Physiol. Behav. 81, 741-748.
23. Caul, W. F., and Brindle, N. A. (2001). Schedule-dependent effects of haloperidol and amphetamine: multipleschedule task shows within-subject effects. Pharmacol. Biochem. Behav. 68, 53-63.
24. Cofer, C. N., and Appley, M. H. (1964). Motivation: Theory and Research. New York, John Wiley and Sons.
25. Collier, G. H., and Jennings, W. (1969). Work as a determinant of instrumental performance. J. Comp. Physiol. Psychol. 68, 659-662.
26. Correa, M., Carlson, B. B., Wisniecki, A., and Salamone, J. D. (2002). Nucleus accumbens dopamine and work requirements on interval schedules. Behav. Brain Res. 137, 179-187.
27. Correa, M., and Font, L. (2008). Is there a major role for adenosine A2A receptors in anxiety? Front. Biosci. 13, 4058-4070.
28. Correa, M., Pardo, M., Hockemeyer, J., Müller, C. E., and Salamone, J. D. (2009). Dopamine D2 Antagonism Increases Selection of Less Effortful Food-seeking Behavior in a T-maze Procedure in Mice: Reversal of the Motivational Impairment with Adenosine Antagonists. Neuroscience Meeting Planner. Washington, DC, Society for Neuroscience (online).
29. Correa, M., Wisniecki, A., Betz, A., Dobson, D. R., O'Neill, M. F., O'Neill, M. J., and Salamone, J. D. (2004). The adenosine A2A antagonist KF17837 reverses the locomotor suppression and tremulous jaw movements induced by haloperidol in rats: possible relevance to parkinsonism. Behav. Brain Res. 148, 47-54.
30. Cousins, M. S., Atherton, A., Turner, L., and Salamone, J. D. (1996). Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behav. Brain Res. 74, 189-197.
31. Cousins, M. S., and Salamone, J. D. (1994). Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit procedure. Pharmacol. Biochem. Behav. 49, 85-91.
32. Cousins, M. S., Sokolowski, J. D., and Salamone, J. D. (1993). Different effects of nucleus accumbens and ventrolateral striatal dopamine depletions on instrumental response selection in the rat. Pharmacol. Biochem. Behav. 46, 943-951.
33. Cousins, M. S., Wei, W., and Salamone, J. D. (1994). Pharmacological characterization of performance on a concurrent lever pressing/feeding choice procedure: effects of dopamine antagonist, cholinomimetic, sedative and stimulant drugs. Psychopharmacology 116, 529-537.
34. Delgado, M. R., Li, J., Schiller, D., and Phelps, E. A. (2008). The role of the striatum in aversive learning and aversive prediction errors. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 363, 3787-3800.
35. DeMet, E. M., and Chicz-DeMet, A. (2002). Localization of adenosine A2A-receptors in rat brain with [3H]ZM-241385. Naunyn Schmiedebergs Arch. Pharmacol. 366, 478-481.
36. Demyttenaere, K., De Fruyt, J., and Stahl, S. M. (2005). The many faces of fatigue in major depressive disorder. Int. J. Neuropsychopharmacol. 8, 93-105.
37. Denk, F., Walton, M. E., Jennings, K. A., Sharp, T., Rushworth, M. F., and Bannerman, D. M. (2005). Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology 179, 587-596.
38. Dunnett, S. B., and Iversen, S. D. (1982). Regulatory impairments following selective 6-OHDA lesions of the neostriatum. Behav. Brain Res. 4, 195-202.
39. Ettenberg, A., Koob, G. F., and Bloom, F. E. (1981). Response artifact in the measurement of neuroleptic-induced anhedonia. Science 213, 357-359.
40. Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8, 1481-1489.
41. Farrar, A. M., Font, L., Pereira, M., Mingote, S. M., Bunce, J. G., Chrobak, J. J., and Salamone, J. D. (2008). Forebrain circuitry involved in effort-related choice: injections of the GABAA agonist muscimol into ventral pallidum alters response allocation in food-seeking behavior. Neuroscience 152, 321-330.
42. Farrar, A. M., Pereira, M., Velasco, F., Hockemeyer, J., Muller, C. E., and Salamone, J. D. (2007). Adenosine A(2A) receptor antagonism reverses the effects of dopamine receptor antagonism on instrumental output and effort-related choice in the rat: implications for studies of psychomotor slowing. Psychopharmacology 191, 579-586.
43. Faure, A., Reynolds, S. M., Richard, J. M., and Berridge, K. C. (2008). Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens. J. Neurosci. 28, 7184-7192.
44. Ferré, S. (1997). Adenosine-dopamine interactions in the ventral striatum. Implications for the treatment of schizophrenia. Psychopharmacology, 133, 107-120.
45. Ferré, S., Ciruela, F., Borycz, J., Solinas, M., Quarta, D., Antoniou, K., Quiroz, C., Justinova, Z., Lluis, C., Franco, R., and Goldberg, S. R. (2008). Adenosine A1-A2A receptor heteromers: new targets for caffeine in the brain. Front. Biosci. 13, 2391-2399.
46. Ferré, S., Ciruela, F., Canals, M., Marcellino, D., Burgueno, J., Casado, V., Hillion, J., Torvinen, M., Fanelli, F., Benedetti, P. P., Goldberg, S. R., Bouvier, M., Fuxe, K., Agnati, L. F., Lluis, C., Franco, R., and Woods. A. (2004). Adenosine A2A-dopamine D2 receptor-receptor heteromers. Targets for neuro-psychiatric disorders. Parkinsonism Relat. Disord. 10, 265-271.
47. Ferré, S., Fredholm, B. B., Morelli, M., Popoli, P., and Fuxe, K. (1997). Adenosine-dopamine receptor-receptor interactions as an integrative mechanism in the basal ganglia. Trends Neurosci. 20, 482-487.
48. Ferré, S., Popoli, P., Giménez-Llort, L., Rimondini, R., Müller, C. E., Strömberg, I., Ögren, S. O., and Fuxe, K. (2001). Adenosine/dopamine interaction: implications for the treatment of Parkinson's disease. Parkinsonism Relat. Disord. 7, 235-241.
49. Fink, J. S., Weaver, D. R., Rivkees, S. A., Peterfreund, R. A., Pollack, A. E., Adler, E. M., and Reppert, S. M. (1992). Molecular cloning of the rat A2A adenosine receptor: selective coexpression with D2 dopamine receptors in rat striatum. Brain Res. Mol. Brain Res. 14, 186-195.
50. Floresco, S. B., and Ghods-Sharifi, S. (2007). Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cereb. Cortex 17, 251-260.
51. Floresco, S. B., St Onge, J. R., Ghods-Sharifi, S., and Winstanley, C. A. (2008a). Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn. Affect. Behav. Neurosci. 8, 375-389.
52. Floresco, S. B., Tse, M. T., and Ghods-Sharifi, S. (2008b). Dopaminergic and glutamatergic regulation of effort-and delay-based decision making. Neuropsychopharmacology 33, 1966-1979.
53. Foltin, R. W. (1991). An economic analysis of "demand" for food in baboons. J. Exp. Anal. Behav. 56, 445-454.
54. Font, L., Mingote, S., Farrar, A. M., Pereira, M., Worden, L., Stopper, C., Port, R. G., and Salamone, J. D. (2008). Intra-accumbens injections of the adenosine A(2A) agonist CGS 21680 affect effort-related choice behavior in rats. Psychopharmacology 199, 515-526.
55. Fouriezos, G., Bielajew, C., and Pagotto, W. (1990). Task difficulty increases thresholds of rewarding brain stimulation. Behav. Brain Res. 37, 1-7.
56. Fuxe, K., Agnati, L. F., Jacobsen, K., Hillion, J., Canals, M., Torvinen, M., Tinner-Staines, B., Staines, W., Rosin, D., Terasmaa, A., Popoli, P., Leo, G., Vergoni, V., Lluis, C., Ciruela, F., Franco, R., and Ferré, S. (2003). Receptor heteromerization in adenosine A2A receptor signaling: relevance for striatal function and Parkinson's disease. Neurology 61, S19-S23.
57. Gawin, F. H. (1986). Neuroleptic reduction of cocaine-induced paranoia but not euphoria? Psychopharmacology 90, 142-143.
58. Guarraci, F. A., and Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 99, 169-179.
59. Hamill, S., Trevitt, J. T., Nowend, K. L., Carlson, B. B., and Salamone, J. D. (1999). Nucleus accumbens dopamine depletions and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacol. Biochem. Behav. 64, 21-27.
60. Haney, M., Ward, A. S., Foltin, R. W., and Fischman, M. W. (2001). Effects of ecopipam, a selective dopamine D1 antagonist, on smoked cocaine self-administration by humans. Psychopharmacology 155, 330-337.
61. Hauber, W., and Munkel, M. (1997). Motor depressant effects mediated by dopamine D2 and adenosine A2A receptors in the nucleus accumbens and the caudate-putamen. Eur. J. Pharmacol. 323, 127-131.
62. Hauber, W., Neuscheler, P., Nagel, J., and Muller, C. E. (2001). Catalepsy induced by a blockade of dopamine D1 or D2 receptors was reversed by a concomitant blockade of adenosine A2A receptors in the caudate putamen of rats. Eur. J. Neurosci. 14, 1287-1293.
63. Hauber, W., and Sommer, S. (2009). Prefrontostriatal circuitry regulates effort-related decision making. Cereb. Cortex [Epub ahead of print]. doi: 10.1093/cercor/bhn241.
64. Hengeveld, G. M., van Langevelde, F., Groen, T. A., and de Knegt, H. J. (2009). Optimal foraging for multiple resources in several food species. Am. Nat. 17, 102-110.
65. Herrnstein, R. J. (1974). Formal properties of the matching law. J. Exp. Anal. Behav. 21, 159-164.
66. Heyman, G. M., and Monaghan, M. M. (1987). The effect of changes in the response requirement and deprivation on the parameters of the matching law equation: new data and review. J. Exp. Psych. An. Behav. Proc. 13, 384-394.
67. Hillion, J., Canals, M., Torvinen, M., Casado, V., Scott, R., Terasmaa, A., Hansson, A., Watson, S., Olah, M. E., Mallol, J., Canela, E. I., Zoli, M., Agnati, L. F., Ibañez, C. F., Lluis, C., Franco, R., Ferré, S., and Fuxe, K. (2002). Coaggregation, cointernalization, and codesensitization of adenosine A2A receptors and dopamine D2 receptors. J. Biol. Chem. 277, 18091-18097.
68. Hursh, S. R., Raslear, T. G., Shurtleff, D., Bauman, R., and Simmons, L. (1988). A cost-benefit analysis of demand for food. J. Exp. Anal. Behav. 50, 419-440.
69. Ishiwari, K., Madson, L. J., Farrar, A. M., Mingote, S. M., Valenta, J. P., DiGianvittorio, M. D., Frank, L. E., Correa, M., Hockemeyer, J., Muller, C., and Salamone, J. D. (2007). Injections of the selective adenosine A2A antagonist MSX-3 into the nucleus accumbens core attenuate the locomotor suppression induced by haloperidol in rats. Behav. Brain Res. 178, 190-199.
70. Ishiwari, K., Weber, S. M., Mingote, S., Correa, M., and Salamone, J. D. (2004). Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements. Behav. Brain Res. 151, 83-91.
71. Jenner, P. (2005). Istradefylline, a novel adenosine A2A receptor antagonist, for the treatment of Parkinson's disease. Expert Opin. Investig. Drugs 14, 729-738.
72. Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., and Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40, 1251-1257.
73. Johnson, D. F., and Collier, G. H. (1987). Caloric regulation and patterns of food choice in a patchy environment: the value and cost of alternative foods. Physiol. Behav. 39, 351-359.
74. Kaufman, L. W. (1980). Foraging costs and meal patterns in ferrets. Physiol. Behav. 25, 139-141.
75. Kaufman, L. W., Collier, G., Hill, W. L., and Collins, K. (1980). Meal cost and meal patterns in an uncaged domestic cat. Physiol. Behav. 25, 135-137.
76. Kelley, A. E., Baldo, B. A., Pratt, W. E., and Will, M. J. (2005). Corticostriatalhypothalamic circuitry and food motivation: integration of energy, action and reward. Physiol. Behav. 86, 773-795.
77. Koch, M., Schmid, A., and Schnitzler, H. U. (2000). Role of nucleus accumbens dopamine D1 and D2 receptors in instrumental and Pavlovian paradigms of conditioned reward. Psychopharmacology 152, 67-73.
78. Koob, G. F., Riley, S. J., Smith, S. C., and Robbins, T. W. (1978). Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi and olfactory tubercle on feeding, locomotor activity, and amphetamine anorexia in the rat. J. Comp. Physiol. Psychol. 92, 917-927.
79. Krebs, J. R. (1977). Optimal foraging: theory and experiment. Nature 268, 583-584.
80. Lapish, C. C., Kroener, S., Durstewitz, D., Lavin, A., Seamans, J. K. (2007). The ability of the mesocortical dopamine system to operate in distinct temporal modes. Psychopharmacology 191, 609-625.
81. Lea, S. E. G. (1978). The psychology and economics of demand. Psychol. Bull. 85, 441-466.
82. Levita, L., Hare, T. A., Voss, H. U., Glover, G., Ballon, D. J., and Casey, B. J. (2009). The bivalent side of the nucleus accumbens. Neuroimage 44, 1178-1187.
83. Liberzon, I., Taylor, S. F., Amdur, R., Jung, T. D., Chamberlain, K. R., Minoshima, S., Koeppe, R. A., and Fig, L. M. (1999). Brain activation in PTSD in response to trauma-related stimuli. Biol. Psychiatry 45, 817-826.
84. Marinelli, M., Barrot, M., Simon, H., Oberlander, C., Dekeyne, A., Le Moal, M., and Piazza, P. V. (1998). Pharmacological stimuli decreasing nucleus accumbens dopamine can act as positive reinforcers but have a low addictive potential. Eur. J. Neurosci. 10, 3269-3275.
85. Marinelli, S., Pascucci, T., Bernardi, G., Puglisi-Allegra, S., and Mercuri, N. B. (2005). Activation of TRPV1 in the VTA excites dopaminergic neurons and increases chemicaland noxious-induced dopamine release in the nucleus accumbens. Neuropsychopharmacology 30, 864-875.
86. Martinez, R. C. R., Oliveira, A. R., Macedo, C. E., Molina, V. A., and Brandao, M. L. (2008). Involvement of dopaminergic mechanisms in the nucleus accumbens core and shell subregions in the expression of fear conditioning. Neurosci. Lett. 446, 112-116.
87. McCullough, L. D., and Salamone, J. D. (1992) Anxiogenic drugs beta-CCE and FG 7142 increase extracellular dopamine levels in nucleus accumbens. Psychopharmacology 109, 379-382.
88. McCullough, L. D., Sokolowski, J. D., and Salamone, J. D. (1993). A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience 52, 919-925.
89. Mekarski, J. E. (1988). Main effects of current and pimozide on prepared and learned self-stimulation behaviors are on performance not reward. Pharmacol. Biochem. Behav. 31, 845-853.
90. Mingote, S., Font, L., Farrar, A. M., Vonte II, R., Worden, L. T., Stopper, C. M., Port, R. G., Sink, K. S., Bunce, J. G., Chrobak, J. J., and Salamone, J. D. (2008). Nucleus accumbens adenosine A2A receptors regulate exertion of effort by acting on the ventral striatopallidal pathway. J. Neurosci. 28, 9037-9046.
91. Mingote, S., Weber, S. M., Ishiwari, K., Correa, M., and Salamone, J. D. (2005). Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. Eur. J. Neurosci 21, 1749-1757.
92. Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97.
93. Morelli, M., and Pinna, A. (2002). Interaction between dopamine and adenosine A2A receptors as a basis for the treatment of Parkinson's disease. Neurol. Sci. 22, 71-72.
94. Mott, A. M, Nunes, E. J., Collins, L. E., Port, R. G., Sink, K. S., Hockemeyer, J., Müller, C. E., and Salamone, J. D. (2009). The adenosine A2A antagonist MSX-3 reverses the effects of the dopamine antagonist haloperidol on effort-related decision making in a T-maze cost/benefit procedure. Psychopharmacology 204, 103-112.
95. Munro, L. J., and Kokkinidis, L. (1997). Infusion of quinpirole and muscimol into the ventral tegmental area inhibits fear-potentiated startle: implications for the role of dopamine in fear expression. Brain Res. 746, 231-238.
96. Nann-Vernotica, E., Donny, E. C., Bigelow, G. E., and Walsh, S. L. (2001). Repeated administration of the D1/5 antagonist ecopipam fails to attenuate the subjective effects of cocaine. Psychopharmacology 155, 338-347.
97. Neill, D. B., and Justice, J. B. (1981). An hypothesis for a behavioral function of dopaminergic transmission in nucleus accumbens. In The Neurobiology of Nucleus Accumbens, R. B. Chronister and J. F. Defrance, eds (Brunswick, Huer Institute).
98. Nicola, S. M. (2007). The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology 191, 521-550.
99. Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191, 507-520.
100. Nowend, K. L., Arizzi, M., Carlson, B. B., and Salamone, J. D. (2001). D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol. Biochem. Behav. 69, 373-382.
101. Nunes, E. J., Farrar, A. M., Font, L., Patel, V., Schlar, D. E., Collins, L. E., Sager, T. N., Correa, M., and Salamone, J. D. (2009). Differential Actions of Adenosine A1 and A2A Antagonists on the Effort-related Effects of Dopamine Antagonists. Neuroscience Meeting Planner. Washington, DC, Society for Neuroscience (online).
102. Palmiter, R. D. (2007). Is dopamine a physiologically relevant mediator of feeding behavior? Trends Neurosci. 30, 375-381.
103. Pavic, L. (2003). Alterations in brain activation in posttraumatic stress disorder patients with severe hyperarousal symptoms and impulsive aggressiveness. Eur. Arch. Psychiatry Clin. Neurosci. 253, 80-83.
104. Pezze, M. A., and Feldon, J. (2004). Mesolimbic dopaminergic pathways in fear conditioning. Prog. Neurobiol. 74, 301-320.
105. Phan, K. L., Taylor, S. F., Welsh, R. C., Ho, S. H., Britton, J. C., and Liberzon, I. (2004). Neural correlates of individual ratings of emotional salience: a trialrelated fMRI study. Neuroimage 21, 768-780.
106. Phillips, P. E., Walton, M. E., and Jhou, T. C. (2007). Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology 191, 483-495.
107. Pinna, A., Wardas, J., Simola, N., and Morelli, M. (2005). New therapies for the treatment of Parkinson's disease: adenosine A2A receptor antagonists. Life Sci. 77, 3259-3267.
108. Pruessner, J. C., Champagne, F., Meaney, M. J., and Dagher, A. (2004). Dopamine release in response to a psychological stress in humans and its relationship to early life maternal care: a positron emission tomography study using [11C]raclopride. J. Neurosci. 24, 2825-2831.
109. Rachlin, H. (2003). Economic concepts in the behavioral study of addiction. In Choice, Behavioral Economics and Addiction, R. E. Vuchinich and N. Heather, eds (Oxford, Elsevier), pp. 129-149.
110. Redgrave, P., Gurney, K., and Reynolds, J. (2008). What is reinforced by phasic dopamine signals? Brain Res. Rev. 58, 322-339.
111. Richardson, N. R., and Roberts, D. C. (1996). Progressive ratio schedules in drug self-administration studies in rats: a method to evaluate reinforcing efficacy. J. Neurosci. Methods 66, 1-11.
112. Rick, J. H., Horvitz, J. C., and Balsam, P. D. (2006). Dopamine receptor blockade and extinction differentially affect behavioral variability. Behav. Neurosci. 120, 488-492.
113. Robbins, T. W., and Everitt, B. J. (2007). A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology 191, 433-437.
114. Robbins, T. W., and Koob, G. F. (1980). Selective disruption of displacement behaviour by lesions of the mesolimbic dopamine system. Nature 285, 409-412.
115. Roitman, M. F., Stuber, G. D., Phillips, P. E., Wightman, R. M., and Carelli, R. M. (2004). Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24, 1265-1271.
116. Salamone, J. D. (1986). Different effects of haloperidol and extinction on instrumental behaviours. Psychopharmacology 88, 18-23.
117. Salamone, J. D. (1987). The actions of neuroleptic drugs on appetitive instrumental behaviors. In Handbook of Psychopharmacology, L. L. Iversen, S. D. Iversen and S. H. Snyder, eds (New York, Plenum Press), pp. 575-608.
118. Salamone, J. D. (1988). Dopaminergic involvement in activational aspects of motivation: effects of haloperidol on schedule induced activity, feeding and foraging in rats. Psychobiology 16, 196-206.
119. Salamone, J. D. (1994). The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 61, 117-133.
120. Salamone, J. D. (1996). The behavioral neurochemistry of motivation: methodological and conceptual issues in studies of the dynamic activity of nucleus accumbens dopamine. J. Neurosci. Methods 64, 137-149.
121. Salamone, J. D. (in press). Involvement of nucleus accumbens dopamine in behavioral activation and effortrelated functions. In Dopamine Handbook, L. L. Iversen, S. D. Iversen, S. B., Dunnett and A. Bjorkland, eds (Oxford, Oxford University Press).
122. Salamone, J. D. (2006). Will the last person who uses the term 'reward' please turn out the lights? Comments on processes related to reinforcement, learning, motivation and effort. Addict. Biol.11, 43-44.
123. Salamone, J. D., Aberman, J. E., Sokolowski, J. D., and Cousins, M. S. (1999). Nucleus accumbens dopamine and rate of responding: neurochemical and behavioral studies. Psychobiology 27, 236-247.
124. Salamone, J. D., Arizzi, M., Sandoval, M. D., Cervone, K. M., and Aberman, J. E. (2002). Dopamine antagonists alter response allocation but do not suppress appetite for food in rats: contrast between the effects of SKF 83566, raclopride and fenfluramine on a concurrent choice task. Psychopharmacology 160, 371-380.
125. Salamone, J. D., Betz, A. J., Ishiwari, K., Felsted, J., Madson, L., Mirante, B., Clark, K., Font, L., Korbey, S., Sager, T. N., Hockemeyer, J., and Muller, C. E. (2008a). Tremorolytic effects of adenosine A2A antagonists: implications for parkinsonism. Front. Biosci. 13, 3594-3605.
126. Salamone, J. D., Ishiwari, K., Betz, A. J., Farrar, A. M., Mingote, S. M., Font, L., Hockemeyer, J., Müller, C. E., and Correa, M. (2008b). Dopamine/ adenosine interactions related to locomotion and tremor in animal models: possible relevance to parkinsonism. Parkinsonism Relat. Disord. 14, S130-S134.
127. Salamone, J. D., and Correa, M. (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res. 137, 3-25.
128. Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191, 461-482.
129. Salamone, J. D., Correa, M., Mingote, S., and Weber, S. M. (2003). Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: implications for studies of natural motivation, psychiatry, and drug abuse. J. Pharmacol. Exp. Ther. 305, 1-8.
130. Salamone, J. D., Correa, M., Mingote, S. M., and Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34-41.
131. Salamone, J. D., Correa, M., Mingote, S. M., Weber, S. M., and Farrar, A. M. (2006). Nucleus accumbens dopamine and the forebrain circuitry involved in behavioral activation and effort-related decision making: implications for understanding anergia and psychomotor slowing in depression. Curr. Psychiatry Rev. 2, 267-280.
132. Salamone, J. D., Cousins, M. S., and Bucher, S. (1994). Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav. Brain Res. 65, 221-229.
133. Salamone, J. D., Cousins, M. S., Maio, C., Champion, M., Turski, T., and Kovach, J. (1996). Different behavioral effects of haloperidol, clozapine and thioridazine in a concurrent lever pressing and feeding procedure. Psychopharmacology 125, 105-112.
134. Salamone, J. D., Cousins, M. S., and Snyder, B. J. (1997). Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci. Biobehav. Rev. 21, 341-359.
135. Salamone, J. D., Farrar, A. M., Font, L., Patel, V., Schlar, D. E., Nunes, E. J., Collins, L. E., and Sager, T. N. (2009). Differential actions of adenosine A1 and A2A antagonists on the effortrelated effects of dopamine D2 antagonism. Behav. Brain Res. 201, 216-222.
136. Salamone, J. D., Kurth, P., McCullough, LD., and Sokolowski, J. D. (1995). The effects of nucleus accumbens dopamine depletions on continuously reinforced operant responding: contrasts with the effects of extinction. Pharmacol. Biochem. Behav. 50, 437-443.
137. Salamone, J. D., Mahan, K., and Rogers, S. (1993a). Ventrolateral striatal dopamine depletions impair feeding and food handling in rats. Pharmacol. Biochem. Behav. 44, 605-610.
138. Salamone, J. D., Kurth, P. A., McCullough, L. D., Sokolowski, J. D., and Cousins, M. S. (1993b). The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding. Brain Res. 628, 218-226.
139. Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., and Mahan, K. (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology 104, 515-521.
140. Salamone, J. D., Wisniecki, A., Carlson, B. B., and Correa, M. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105, 863-870.
141. Sanchis-Segura, C., and Spanagel, R. (2006). Behavioural assessment of drug reinforcement and addictive features in rodents: an overview. Addict. Biol. 11, 2-38.
142. Sarchiapone, M., Carli, V., Camardese, G., Cuomo, C., Di Guida, D., Calgagni, M. L., Focacci, C., and De Riso, S. (2006). Dopamine transporter binding in depressed patients with anhedonia. Psychiatry Res. Neuroimag. 147, 243-248.
143. Schiffmann, S. N., Jacobs, O., and Vanderhaeghen, J. J. (1991). Striatal restricted adenosine A2A receptor (RDC8) is expressed by enkephalin but not by substance P neurons: an in situ hybridization histochemistry study. J. Neurochem. 57, 1062-1071.
144. Schmelzeis, M. C., and Mittleman, G. (1996). The hippocampus and reward: effects of hippocampal lesions on progressive-ratio responding. Behav. Neurosci. 110, 1049-1066.
145. Schultz, W. (2007a). Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259-288.
146. Schultz, W. (2007b). Behavioral dopamine signals. Trends Neurosci. 30, 203-210.
147. Schweimer, J., and Hauber, W. (2005). Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy. Learn. Mem. 12, 334-342.
148. Sink, K. S., Vemuri, V. K., Olszewska, T., Makriyannis, A., and Salamone, J. D. (2008). Cannabinoid CB1 antagonists and dopamine antagonists produce different effects on a task involving response allocation and effort-related choice in food-seeking behavior. Psychopharmacology 196, 565-574.
149. Skjoldager, P., Pierre, P. J., and Mittlman, G. (1993). Reinforcer magnitude and progressive ratio responding: effects of increased effort, prefeeding and extinction. Learn. Motiv. 24, 303-343.
150. Sokolowski, J. D., and Salamone, J. D. (1998). The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacol. Biochem. Behav. 59, 557-566.
151. Staddon, J. E. R. (1979). Operant behavior as adaptation to constraint. J. Exp. Psychol. Gen. 108, 48-67.
152. Stahl, S. M. (2002). The psychopharmacology of energy and fatigue. J. Clin. Psychiatry 63, 7-8.
153. Stewart, W. J. (1974). Progressive reinforcement schedules: a review and evaluation. Aust. J. Psychol. 27, 9-22.
154. Svenningsson, P., Le Moine, C., Fisone, G., and Fredholm, B. B. (1999). Distribution, biochemistry and function of striatal adenosine A2A receptors. Prog. Neurobiol. 59, 355-396.
155. Szczypka, M. S., Kwok, K., Brot, M. D., Marck, B. T., Matsumoto, A. M., Donahue, B. A., and Palmiter, R. D. (2001). Dopamine production in the caudate putamen restores feeding in dopamine-deficient mice. Neuron 30, 819-828.
156. Takahashi, R. N., Pamplona, F. A., and Prediger, R. D. (2008). Adenosine receptor antagonists for cognitive dysfunction: a review of animal studies. Front. Biosci. 13, 2614-2632.
157. Ungerstedt, U. (1971). Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigrostriatal dopamine system. Acta Physiol. Scand. Suppl. 367, 95-122.
158. van den Bos, R., van der Harst, J., Jonkman, S., Schilders, M., and Spruijt, B. (2006). Rats assess costs and benefits according to an internal standard. Behav. Brain Res. 171, 350-354.
159. Vezina, P., Lorrain, D. S., Arnold, G. M., Austin, J. D., and Suto, N. (2002). Sensitization of midbrain dopamine neuron reactivity promotes the pursuit of amphetamine. J. Neurosci. 22, 4654-4662.
160. Vuchinich, R. E., and Heather, N. (2003). Introduction: Overview of behavioural economic perspectives on substance use and addiction. In Choice, Behavioral Economics and Addiction, R. E. Vuchinich and N. Heather, eds (Oxford, Elsevier), pp. 1-31.
161. Wachtel, S. R., Ortengren, A., and de Wit, H. (2002). The effects of acute haloperidol or risperidone on subjective responses to methamphetamine in healthy volunteers. Drug Alcohol Depend. 68, 23-33.
162. Wacker, J., Dillon, D. G., and Pizzagalli, D. A. (2009). The role of the nucleus accumbens and rostral anterior cingulate cortex in anhedonia: integration of resting EEG, fMRI, and volumetric techniques. Neuroimage 46, 327-337.
163. Wakabayashi, K. T., Fields, H. L., and Nicola, S. M. (2004). Dissociation of the role of nucleus accumbens dopamine in responding to rewardpredictive cues and waiting for reward. Behav. Brain Res. 154, 19-30.
164. Wallace, M., Singer, G., Finlay, J., and Gibson, S. (1983). The effect of 6-OHDA lesions of the nucleus accumbens septum on scheduleinduced drinking, wheelrunning and corticosterone levels in the rat. Pharmacol. Biochem. Behav. 18, 129-136.
165. Walton, M. E., Bannerman, D. M., Alterescu, K., and Rushworth, M. F. S. (2003). Functional specialization within medial frontal cortex of the anterior cingulated for evaluating effort-related decisions. J. Neurosci. 23, 6475-6479.
166. Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E., and Rushworth, M. F. (2006). Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Netw. 19, 1302-1314.
167. Wardas, J., Konieczny, J., and Lorenc-Koci, E. (2001). SCH 58261, an A2A adenosine receptor antagonist, counteracts parkinsonian-like muscle rigidity in rats. Synapse 41, 160-171.
168. Williams, B. A. (1988). Reinforcement, choice, and response strength. In Stevens' Handbook of Experimental Psychology Vol. 2, R. C. Atkinson, R. J. Herrnstein, G. Lindsey and R. D. Luce, eds (New York, John Wiley and Sons), pp. 167-174.
169. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
170. Woolverton, W. L., and Ranaldi, R. (2002). Comparison of the reinforcing efficacy of two dopamine D2-like receptor agonists in rhesus monkeys using a progressive-ratio schedule of reinforcement. Pharmacol. Biochem. Behav. 72, 803-809.
171. Worden, L. T., Shahriari, M., Farrar, A. M., Sink, K. S., Hockemeyer. J., Müller, C., Salamone, JD. (2009). The adenosine A2A antagonist MSX-3 reverses the effort-related effects of dopamine blockade: differential interaction with D1 and D2 family antagonists. Psychopharmacology 203, 489-499.
172. Yin, H. H., Ostlund, S. B., and Balleine, B. W. (2008). Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur. J. Neurosci. 28, 1437-1448.
173. Young, A. M. (2004). Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats. J. Neurosci. Methods 138, 57-63.