The behavioral pharmacology of effort-related choice behavior: Dopamine, adenosine and beyond

Journal of the Experimental Analysis of Behavior

Volumn 97, Issue 1, 2012, Pages 125-146

  Salamone, John D ^a   Correa, Merce ^a,b   Nunes, Eric J ^a   Randall, Patrick A ^a   Pardo, Marta ^a,b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b UNIVERSITAT JAUME I   (Spain)

Author keywords

Adenosine; Behavioral economics; Dopamine; Effort; Reinforcement; Review; Work

Indexed keywords

ADENOSINE; DOPAMINE;

ADDICTION; ADULT; AMYGDALOID NUCLEUS; ANIMAL; ARTICLE; CINGULATE GYRUS; DECISION MAKING; DEPRESSION; EXERCISE; GLOBUS PALLIDUS; HUMAN; INSTRUMENTAL CONDITIONING; MOTIVATION; NERVE CELL NETWORK; NUCLEUS ACCUMBENS; PATHOPHYSIOLOGY; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; REINFORCEMENT; SPECIES DIFFERENCE; SYNAPTIC TRANSMISSION;

ADENOSINE; AMYGDALA; ANIMALS; CHOICE BEHAVIOR; CONDITIONING, OPERANT; DEPRESSION; DOPAMINE; GLOBUS PALLIDUS; GYRUS CINGULI; HUMANS; MOTIVATION; NERVE NET; NUCLEUS ACCUMBENS; PHYSICAL EXERTION; REINFORCEMENT SCHEDULE; SPECIES SPECIFICITY; SUBSTANCE-RELATED DISORDERS; SYNAPTIC TRANSMISSION; YOUNG ADULT;

EID: 84858328727     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2012.97-125     Document Type: Article

References (240)

1. Aberman, J. E., & Salamone, J. D. (1999). Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience, 92, 545- 552.
2. Allison, J. (1981). Economics and operant conditioning. In P. Harzem, & M. D. Zeiler (Eds.), Predictability, correlation and contiguity (pp. 321-353). New York: John Wiley and Sons.
3. Allison, J. (1993). Response deprivation, reinforcement, and economics. Journal of the Experimental Analysis of Behavior, 60, 129-140.
4. Amtage, J., & Schmidt, W. J. (2003). Context-dependent catalepsy intensification is due to classical conditioning and sensitization. Behavioural Pharmacology, 14, 563-567.
5. Anstrom, K. K., & Woodward, D. J. (2005). Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology, 30, 1832-1840.
6. Aparicio, C. F. (2001). Overmatching in rats: the barrier choice paradigm. Journal of the Experimental Analysis of Behavior, 75, 93-106.
7. Aparicio, C. F. (2007). Haloperidol, dynamics of choice, and the parameters of the matching law. Behavioral Processes, 75, 206-212.
8. Arnold, J. M., & Roberts, D. C. (1997). A critique of fixed and progressive ratio schedules used to examine the neural substrates of drug reinforcement. Pharmacology, Biochemistry and Behavior, 57, 441-447.
9. Asin, K. E., & Fibiger, H. C. (1984). Force requirements in lever-pressing and responding after haloperidol. Pharmacology, Biochemistry and Behavior, 20 (3), 323- 326.
10. Bakshi, V. P., & Kelley, A. E. (1991). Dopaminergic regulation of feeding behavior: I. Differential effects of haloperidol microinjection in three striatal subregions. Psychobiology, 19, 223-232.
11. Baldo, B. A., & Kelley, A. E. (2007). Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding. Psychopharmacology, 191, 439-459.
12. Baldo, B. A., Sadeghian, K., Basso, A. M., & Kelley, A. E. (2002). Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on ingestive behavior and associated motor activity. Behavioural Brain Research, 137, 165-177.
13. Barbano, M. F., & Cador, M. (2007). Opioids for hedonic experience and dopamine to get ready for it. Psychopharmacology, 191, 497-506.
14. Bardgett, M. E., Depenbrock, M., Downs, N., Points, M., & Green, L. (2009). Dopamine modulates effort-based decision making in rats. Behavioral Neuroscience, 123, 242-251.
15. Barrett, J. E., & Bergman, J. (2008). Peter B. Dews and pharmacological studies on behavior. Journal of Pharmacology and Experimental Therapeutics, 326, 683-690.
16. Baum, W. M. (1974). On two types of deviation from the matching law: bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
17. Beninger, R. J., Cheng, M., Hahn, B. L., Hoffman, D. C., Mazurski, E. J., Morency, M. A., Ramm, P., & Stewart, R. J. (1987). Effects of extinction, pimozide, SCH 23390, and metoclopramide on food-rewarded operant responding of rats. Psychopharmacology, 92, 343- 349.
18. Beninger, R. J., & Gerdjikov, T. (2004). The role of signaling molecules in reward-related incentive learning. Neurotoxicology Research, 6, 91-104.
19. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology, 191, 391-431.
20. Berridge, K. C., & Kringlebach, M. L. (2008). Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology, 199, 457-480.
21. Berridge, K. C., & Robinson, T. E. (2003). Parsing reward. Trends in Neuroscience, 26, 507-513.
22. Bickel, W. K., Marsch, L. A., & Carroll, M. E. (2000). Deconstructing relative reinforcing efficacy and situating the measures of pharmacological reinforcement with behavioral economics: a theoretical proposal. Psychopharmacology, 153, 44-56.
23. Blazquez, P. M., Fujii, N., Kojima, J., & Graybiel, A. M. (2002). A network representation of response probability in the striatum. Neuron, 33, 973-982.
24. Brauer, L. H., & De Wit, H. (1997). High dose pimozide does not block amphetamine-induced euphoria in normal volunteers. Pharmacology, Biochemistry and Behavior, 56, 265-272.
25. Brischoux, F., Chakraborty, S., Brierley, D. I., & Ungless, M. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proceedings of the National Academy of Sciences, 106, 4894-4899.
26. Broom, S. L., & Yamamoto, B. K. (2005). Effects of subchronic methamphetamine exposure on basal dopamine and stress-induced dopamine release in the nucleus accumbens shell of rats. Psychopharmacology, 181, 467-476.
27. Cagniard, B., Balsam, P. D., Brunner, D., & Zhuang, X. (2006). Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology, 31, 1362-1370
28. Cannon, C. M., & Bseikri, M. R. (2004). Is dopamine required for natural reward? Physiology and Behavior, 81, 741-748
29. Caul, W. F., & Brindle, N. A. (2001). Schedule-dependent effects of haloperidol and amphetamine: multipleschedule task shows within-subject effects. Pharmacology, Biochemistry, and Behavior, 68, 53-63.
30. Collier, G. H., & Jennings, W. (1969). Work as a determinant of instrumental performance. Jounral of Comparative and Physiological Psychology, 68, 659-662.
31. Correa, M., Carlson, B. B., Wisniecki, A., & Salamone, J. D. (2002). Nucleus accumbens dopamine and work requirements on interval schedules. Behavioural Brain Research, 137, 179-187.
32. Correa, M., & Font, L. (2008). Is there a major role for adenosine A2A receptors in anxiety? Frontiers in Bioscience, 13, 4058-4070.
33. Correa, M., Wisniecki, A., Betz, A., Dobson, D. R., O'Neill, M. F., O'Neill, M. J., & Salamone, J. D. (2004). The adenosine A2A antagonist KF17837 reverses the locomotor suppression and tremulous jaw movements induced by haloperidol in rats: possible relevance to parkinsonism. Behavioural Brain Research, 148, 47-54.
34. Cousins, M. S., Atherton, A., Turner, L., & Salamone, J. D. (1996). Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behavioural Brain Research, 74, 189-197.
35. Cousins, M. S., & Salamone, J. D. (1994). Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit procedure. Pharmacology, Biochemistry, and Behavior, 49, 85-91.
36. Cousins, M. S., Sokolowski, J. D., & Salamone, J. D. (1993). Different effects of nucleus accumbens and ventrolateral striatal dopamine depletions on instrumental response selection in the rat. Pharmacology, Biochemistry, and Behavior, 46, 943-951.
37. Cousins, M. S., Wei, W., & Salamone, J. D. (1994). Pharmacological characterization of performance on a concurrent lever pressing/feeding choice procedure: effects of dopamine antagonist, cholinomimetic, sedative and stimulant drugs. Psychopharmacology, 116, 529-537.
38. Das, S., & Fowler, S. C. (1996). An update of Fowler and Das: Anticholinergic reversal of haloperidol-induced, within-session decrements in rats' lapping behavior. Pharmacology, Biochemistry and Behavior, 53, 853-855.
39. Day, J. J., Wheeler, R. A., Roitman, M. F., & Carelli, R. M. (2006). Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm. European Journal of Neuroscience, 23, 1341-1351.
40. Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011). Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers. Frontiers in Neuroscience, 5, 71.
41. Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008). The role of the striatum in aversive learning and aversive prediction errors. Philosophical Transactions of the Royal Society, 363, 3787-3800.
42. DeMet, E. M., & Chicz-DeMet, A. (2002). Localization of adenosine A2A-receptors in rat brain with [3H]ZM-241385. Naunyn-Schmiedeberg's Archives of Pharmacology, 366, 478-481.
43. Demyttenaere, K., De Fruyt, J., & Stahl, S. M. (2005). The many faces of fatigue in major depressive disorder. International Journal of Neuropsychopharmacology, 8, 93-105.
44. Denk, F., Walton, M. E., Jennings, K. A., Sharp, T., Rushworth, M. F., & Bannerman, D. M. (2005). Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology, 179, 587-596.
45. Dews, P. B. (1976). Interactions of behavioral effects of drugs. Annals of the New York Academy of Sciences, 281, 50-63.
46. Di Ciano, P., Cardinal, R. N., Cowell, R. A., Little, S. J., & Everitt, B. J. (2001). Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of Pavlovian approach behavior. Journal of Neuroscience, 21, 9471-9477.
47. Dickinson, A., & Balleine, B. (1994). Motivational control of goal-directed action. Animal Learning and Behavior, 22, 1-18.
48. Dunnett, S. B., & Iversen, S. D. (1982). Regulatory impairments following selective 6-OHDA lesions of the neostriatum. Behavioral Brain Research, 4, 195-202.
49. Ettenberg, A., Koob, G. F., & Bloom, F. E. (1981). Response artifact in the measurement of neuroleptic-induced anhedonia. Science, 213, 357-359.
50. Evenden, J. L., & Robbins, T. W. (1983). Dissociable effects of d-amphetamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology, 79, 180-86.
51. Everitt, B. J., Parkinson, J. A., Olmstead, M. C., Arroyo, M., Robledo, P., & Robbins, T. W. (1999). Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Annals of the New York Academy of Sciences, 877, 412-438.
52. Everitt, B. J., & Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature Neuroscience, 8, 1481- 1489.
53. Farrar, A. M., Font, L., Pereira, M., Mingote, S. M., Bunce, J. G., Chrobak, J. J., & Salamone, J. D. (2008). Forebrain circuitry involved in effort-related choice: injections of the GABAA agonist muscimol into ventral pallidum alters response allocation in food-seeking behavior. Neuroscience, 152, 321-330.
54. Farrar, A. M., Pereira, M., Velasco, F., Hockemeyer, J., Muller, C. E., & Salamone, J. D. (2007). Adenosine A(2A) receptor antagonism reverses the effects of dopamine receptor antagonism on instrumental output and effort-related choice in the rat: implications for studies of psychomotor slowing. Psychopharmacology, 191, 579-586.
55. Farrar, A. M., Segovia, K. N., Randall, P. A., Nunes, E. J., Collins, L. E., Stopper, C. M., Port, R. G., Hockemeyer, J., Müller, C. E., Correa, M., & Salamone, J. D. (2010). Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors. Neuroscience, 166, 1056-1067.
56. Faure, A., Reynolds, S. M., Richard, J. M., & Berridge, K. C. (2008). Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens. Journal of Neuroscience, 28, 7184-7192.
57. Faustman, W. O., & Fowler, S. C. (1981). Use of operant response duration to distinguish the effects of haloperidol from nonreward. Pharmacology Biochemistry and Behavior, 15 (2), 327-329.
58. Faustman, W. O., & Fowler, S. C. (1982). An examination of methodological refinements, clozapine and fluphenazine in the anhedonia paradigm. Pharmacology Biochemistry and Behavior, 17 (5), 987-993.
59. Feldon, J., & Weiner, I. (1991). Effects of haloperidol on the multitrial partial reinforcement extinction effect (PREE): evidence for neuroleptic drug action on nonreinforcement but not on reinforcement. Psychopharmacology, 105, 407-414.
60. Ferré, S. (1997). Adenosine-dopamine interactions in the ventral striatum. Implications for the treatment of schizophrenia. Psychopharmacology, 133, 107-120.
61. Ferré, S., Ciruela, F., Borycz, J., Solinas, M., Quarta, D., Antoniou, K., Quiroz, C., Justinova, Z., Lluis, C., Franco, R., & Goldberg, S. R. (2008). Adenosine A1- A2A receptor heteromers: new targets for caffeine in the brain. Frontiers in Bioscience, 13, 2391-2399.
62. Ferré, S., Ciruela, F., Canals, M., Marcellino, D., Burgueno, J., Casado, V., Hillion, J., Torvinen, M., Fanelli, F., Benedetti, P. P., Goldberg, S. R., Bouvier, M., Fuxe, K., Agnati, L. F., Lluis, C., Franco, R., & Woods, A. (2004). Adenosine A2A-dopamine D2 receptor-receptor heteromers. Targets for neuro-psychiatric disorders. Parkinsonism and Related Disorders, 10, 265-271.
63. Ferré, S., Fredholm, B. B., Morelli, M., Popoli, P., & Fuxe, K. (1997). Adenosine-dopamine receptor-receptor interactions as an integrative mechanism in the basal ganglia. Trends in Neuroscience, 20, 482-487.
64. Ferré, S., Popoli, P., Giménez-Llort, L., Rimondini, R., Müller, C. E., Strömberg, I., Ögren, S. O., & Fuxe, K. (2001). Adenosine/dopamine interaction: implications for the treatment of Parkinson's disease. Parkinsonism and Related Disorders, 7, 235-241.
65. Fibiger, H. C., Carter, D. A., & Phillips, A. G. (1976). Decreased intracranial self-stimulation after neuroleptics or 6-hydroxydopamine: Evidence for mediation by reward deficits rather than by reduced reward. Psychopharmacology, 47, 21-27.
66. Fink, J. S., Weaver, D. R., Rivkees, S. A., Peterfreund, R. A., Pollack, A. E., Adler, E. M., & Reppert, S. M. (1992). Molecular cloning of the rat A2A adenosine receptor: selective co-expression with D2 dopamine receptors in rat striatum. Molecular Brain Research, 14, 186-195.
67. Floresco, S. B., & Ghods-Sharifi, S. (2007). Amygdalaprefrontal cortical circuitry regulates effort-based decision making. Cerebral Cortex, 17, 251-260.
68. Floresco, S. B., St. Onge, J. R., Ghods-Sharifi, S., & Winstanley, C. A. (2008). Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cognitive Affective Behavioral Neuroscience, 8, 375-389.
69. Floresco, S. B., Tse, M. T., & Ghods-Sharifi, S. (2008). Dopaminergic and glutamatergic regulation of effortand delay-based decision making. Neuropsychopharmacology, 33, 1966-1979.
70. Foltin, R. W. (1991). An economic analysis of "demand" for food in baboons. Journal of the Experimental Analysis of Behavior, 56, 445-454.
71. Font, L., Mingote, S., Farrar, A. M., Pereira, M., Worden, L., Stopper, C., Port, R. G., & Salamone, J. D. (2008). Intra-accumbens injections of the adenosine A(2A) agonist CGS 21680 affect effort-related choice behavior in rats. Psychopharmacology, 199, 515-526.
72. Fouriezos, G., Bielajew, C., & Pagotto, W. (1990). Task difficulty increases thresholds of rewarding brain stimulation. Behavioral Brain Research, 37, 1-7.
73. Fuxe, K., Agnati, L. F., Jacobsen, K., Hillion, J., Canals, M., Torvinen, M., Tinner-Staines, B., Staines, W., Rosin, D., Terasmaa, A., Popoli, P., Leo, G., Vergoni, V., Lluis, C., Ciruela, F., Franco, R., & Ferré, S. (2003). Receptor heteromerization in adenosine A2A receptor signaling: relevance for striatal function and Parkinson's disease. Neurology, 61, S19-23.
74. Gawin, F. H. (1986). Neuroleptic reduction of cocaineinduced paranoia but not euphoria? Psychopharmacology, 90, 142-143.
75. Gramling, S. E., Fowler, S. C., & Collins, K. R. (1984). Some effects of pimozide on nondeprived rats licking sucrose solutions in an anhedonia paradigm. Pharmacology Biochemistry and Behavior, 21, 617-624.
76. Gramling, S. E., Fowler, S. C., & Tizzano, J. P. (1987). Some effects of pimozide on nondeprived rats' lever pressing maintained by a sucrose reward in an anhedonia paradigm. Pharmacology Biochemistry and Behavior, 27, 67-72.
77. Guarraci, F. A., & Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential Pavlovian fear conditioning in the awake rabbit. Behavioral. Brain Research, 99, 169-179.
78. Haase, H. J., & Janssen, P. A. J. (1985). The action of neuroleptic drugs. Amsterdam: Elsevier Science Publishers
79. Hamill, S., Trevitt, J. T., Nowend, K. L., Carlson, B. B., & Salamone, J. D. (1999). Nucleus accumbens dopamine depletions and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacology, Biochemistry, and Behavior, 64, 21-27.
80. Haney, M., Ward, A. S., Foltin, R. W., & Fischman, M. W. (2001). Effects of ecopipam, a selective dopamine D1 antagonist, on smoked cocaine self-administration by humans. Psychopharmacology, 155, 330-337.
81. Hauber, W. (2010). Dopamine release in the prefrontal cortex and striatum: temporal and behavioural aspects. Pharmacopsychiatry, 43, S32-41.
82. Hauber, W., & Munkel, M. (1997). Motor depressant effects mediated by dopamine D2 and adenosine A2A receptors in the nucleus accumbens and the caudateputamen. European Journal of Pharmacology, 323, 127-131.
83. Hauber, W., Neuscheler, P., Nagel, J., & Muller, C. E. (2001). Catalepsy induced by a blockade of dopamine D1 or D2 receptors was reversed by a concomitant blockade of adenosine A2A receptors in the caudate putamen of rats. European Journal of Neuroscience, 14, 1287-1293.
84. Hauber, W., & Sommer, S. (2009). Prefrontostriatal circuitry regulates effort-related decision making. Cerebral Cortex, 10, 2240-2247.
85. Hengeveld, G. M., van Langevelde, F., Groen, T. A., & de Knegt, H. J. (2009). Optimal foraging for multiple resources in several food species. American. Naturalist, 17, 102-110.
86. Hernandez, G., Breton, Y. A., Conover, K., & Shizgal, P. (2010). At what stage of neural processing does cocaine act to boost pursuit of rewards? PLoS One, 5, e15081.
87. Herrnstein, R. J. (1974). Formal properties of the matching law. Journal of the Experimental Analysis of Behavior, 21, 159-164.
88. Heyman, G. M. (2000). An economic approach to animal models of alcoholism. Alcohol Research & Health, 24, 132-139.
89. Heyman, G. M. (2009). Addiction: A disorder of choice. Cambridge, MA: Harvard University Press.
90. Heyman, G. M., Monaghan, M. M., & Clody, D. E. (1987). Low doses of cis-flupentixol attenuate motor performance. Psychopharmacology, 93, 477-482.
91. Hillion, J., Canals, M., Torvinen, M., Casado, V., Scott, R., Terasmaa, A., Hansson, A., Watson, S., Olah, M. E., Mallol, J., Canela, E. I., Zoli, M., Agnati, L. F., Ibañez, C. F., Lluis, C., Franco, R., Ferré, S., & Fuxe, K. (2002). Coaggregation, cointernalization, and codesensitization of adenosine A2A receptors and dopamine D2 receptors. The Journal of Biological Chemistry, 277, 18091-18097.
92. Hursh, S. R. (1993). Behavioral economics of drug selfadministration: An Introduction. Drug and Alcohol Dependence, 33, 165-172.
93. Hursh, S. R., Raslear, T. G., Shurtleff, D., Bauman, R., & Simmons, L. (1988). A cost-benefit analysis of demand for food. Journal of the Experimental Analysis of Behavior, 50, 419-440.
94. Ikemoto, S., & Panksepp, J. (1996). Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. Behavioral Neuroscience, 110, 331-345.
95. Ishiwari, K., Madson, L. J., Farrar, A. M., Mingote, S. M., Valenta, J. P., DiGianvittorio, M. D., Frank, L. E., Correa, M., Hockemeyer, J., Muller, C., & Salamone, J. D. (2007). Injections of the selective adenosine A2A antagonist MSX-3 into the nucleus accumbens core attenuate the locomotor suppression induced by haloperidol in rats. Behavioural Brain Research, 178, 190-199.
96. Ishiwari, K., Weber, S. M., Mingote, S., Correa, M., & Salamone, J. D. (2004). Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements. Behavioural Brain Research, 151, 83-91.
97. Jacobson, N. S., Martell, C. R., & Dimidjian, S. (2001). Behavioral activation treatment for depression: returning to contextual roots. Clinical Psychology: Science & Practice, 8, 225-270.
98. Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron, 40, 1251-1257.
99. Johnson, D. F., & Collier, G. H. (1987). Caloric regulation and patterns of food choice in a patchy environment: the value and cost of alternative foods. Physiological Behavior, 39, 351-359.
100. Kaufman, L. W. (1980). Foraging costs and meal patterns in ferrets. Physiology & Behavior, 25, 139-141.
101. Kaufman, L. W., Collier, G., Hill, W. L., & Collins, K. (1980). Meal cost and meal patterns in an uncaged domestic cat. Physiological Behavior, 25, 135-137.
102. Kelley, A. E., Baldo, B. A., Pratt, W. E., & Will, M. J. (2005). Corticostriatal-hypothalamic circuitry and food motivation: integration of energy, action and reward. Physiological Behavior, 86, 773-795.
103. Killeen, P. (1975). On the temporal control of behavior. Psychological Review, 82, 89-115.
104. Killeen, P. R. (1994). Mathematical principles of reinforcement. Behavioral and Brain Sciences, 17, 105-172.
105. Killeen, P. R. (1995). Economics, ecologics and mechanics: the dynamics of responding under conditions of varying motivation. Journal of the Experimental Analysis of Behavior, 64, 405-431.
106. Killeen, P. R., Hanson, S. J., & Osborne, S. R. (1978). Arousal: Its genesis and manifestation as response rate. Psychological Review, 85, 571-581.
107. Koch, M., Schmid, A., & Scnhnitzler, H. U. (2000). Role of nucleus accumbens dopamine D1 and D2 receptors in instrumental and Pavlovian paradigms of conditioned reward. Psychopharmacology, 152, 67-73.
108. Koffarnus, M. N., Newman, A. H., Grundt, P., Rice, K. C., & Woods, J. H. (2011). Effects of selective dopaminergic compounds on a delay-discounting task. Behavioural Pharmacology, 22, 300-311.
109. Koob, G. F., Riley, S. J., Smith, S. C., & Robbins, T. W. (1978). Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi and olfactory tubercle on feeding, locomotor activity, and amphetamine anorexia in the rat. Journal of Comparative Physiological Psychology, 92, 917-927.
110. Lack, C. M., Jones, S. R., & Roberts, D. C. (2008). Increased breakpoints on a progressive ratio schedule reinforced by IV cocaine are associated with reduced locomotor activation and reduced dopamine efflux in nucleus accumbens shell in rats. Psychopharmacology, 195, 517-525.
111. Lea, S. E. G. (1978). The psychology and economics of demand. Psychological Bulletin, 85, 441-466.
112. Levita, L., Hare, T. A., Voss, H. U., Glover, G., Ballon, D. J., & Casey, B. J. (2009). The bivalent side of the nucleus accumbens. Neuroimage, 44, 1178-1187.
113. Liao, R. M., & Fowler, S. C. (1990). Haloperidol produces within-session increments in operant response duration in rats. Pharmacology, Biochemistry and Behavior, 36, 199-201.
114. Liberzon, I., Taylor, S. F., Amdur, R., Jung, T. D., Chamberlain, K. R., Minoshima, S., Koeppe, R. A., & Fig, L. M. (1999). Brain activation in PTSD in response to trauma-related stimuli. Biological Psychiatary, 45, 817-826.
115. Madden, G. J., Bickel, W. K., & Jacobs, E. A. (2000). Three predictions of the economic concept of unit price in a choice context. Journal of the Experimental Analysis of Behavior, 73, 45-64.
116. Madden, G. J., & Kalman, D. (2010). Effects of bupropion on simulated demand for cigarettes and the subjective effects of smoking. Nicotine & Tobacco Research, 12, 416-422.
117. Madden, G. J., Smethells, J. R., Ewan, E. E., & Hursh, S. R. (2007). Tests of behavioral-economic assessments of relative reinforcer efficacy II: economic complements. Journal of the Experimental Analysis of Behavior, 88, 355-367.
118. Marinelli, M., Barrot, M., Simon, H., Oberlander, C., Dekeyne, A., Le Moal, M., & Piazza, P. V. (1998). Pharmacological stimuli decreasing nucleus accumbens dopamine can act as positive reinforcers but have a low addictive potential. Eurpeoan Journal of Neuroscience, 10, 3269-3275.
119. Marinelli, S., Pascucci, T., Bernardi, G., Puglisi-Allegra, S., & Mercuri, N. B. (2005). Activation of TRPV1 in the VTA excites dopaminergic neurons and increases chemical- and noxious-induced dopamine release in the nucleus accumbens. Neuropsychopharmacology, 30, 864-875.
120. Martinez, R. C. R., Oliveira, A. R., Macedo, C. E., Molina, V. A., & Brandao, M. L. (2008). Neuroscience Letters, 446, 112-116.
121. Martin-Iverson, M. T., Wilke, D., & Fibiger, H. C. (1987). Effect of haloperidol and d-amphetamine on perceived quantity of food and tones. Psychopharamcology, 93, 374-381.
122. McCullough, L. D., & Salamone, J. D. (1992). Anxiogenic drugs beta-CCE and FG 7142 increase extracellular dopamine levels in nucleus accumbens. Psychopharmacology, 109 (3), 379-382.
123. McCullough, L. D., Sokolowski, J. D., & Salamone, J. D. (1993). A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience, 52 (4), 919-925.
124. McMillan, D. E., & Katz, J. L. (2002). Continuing implications of the early evidence against thedrive-reduction hypothesis of the behavioral effects of drugs. Psychopharmacology, 163, 251-264.
125. Mekarski, J. E. (1988). Main effects of current and pimozide on prepared and learned self-stimulation behaviors are on performance not reward. Pharmacology Biochemistry and Behavior, 31, 845-853.
126. Mingote, S., Font, L., Farrar, A. M., Vontell, R., Worden, L. T., Stopper, C. M., Port, R. G., Sink, K. S., Bunce, J. G., Chrobak, J. J., & Salamone, J. D. (2008). Nucleus accumbens adenosine A2A receptors regulate exertion of effort by acting on the ventral striatopallidal pathway. Journal of Neuroscience, 28, 9037-9046.
127. Mingote, S., Weber, S. M., Ishiwari, K., Correa, M., & Salamone, J. D. (2005). Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. European Journal of Neuroscience, 21, 1749-1757.
128. Mobini, S., Chiang, T. J., Ho, M. Y., Bradshaw, C. M., & Szabadi, E. (2000). Comparison of the effects of clozapine, haloperidol, chlorpromazine and d-amphetamine on performance on a time-constrained progressive ratio schedule and on locomotor behaviour in the rat. Psychopharmacology, 152, 47-54.
129. Morelli, M., & Pinna, A. (2002). Interaction between dopamine and adenosine A2A receptors as a basis for the treatment of Parkinson's disease. Neurological Sciences, 22, 71-72.
130. Morgan, D., Brebner, K., Lynch, W. J., & Roberts, D. C. (2002). Increases in the reinforcing efficacy of cocaine after particular histories of reinforcement. Behavioural Pharmacology, 13, 389-396.
131. Mott, A. M., Nunes, E. J., Collins, L. E., Port, R. G., Sink, K. S., Hockemeyer, J., Müller, C. E., & Salamone, J. D. (2009). The adenosine A2A antagonist MSX-3 reverses the effects of the dopamine antagonist haloperidol on effort-related decision making in a T-maze cost/benefit procedure. Psychopharmacology, 204, 103-112.
132. Munro, L. J., & Kokkinidis, L. (1997). Infusion of quinpirole and muscimol into the ventral tegmental area inhibits fear-potentiated startle: implications for the role of dopamine in fear expression. Brain Research, 746, 231-238.
133. Nann-Vernotica, E., Donny, E. C., Bigelow, G. E., & Walsh, S. L. (2001). Repeated administration of the D1/5 antagonist ecopipam fails to attenuate the subjective effects of cocaine. Psychopharmacology, 155, 338-347.
134. Neill, D. B., & Justice, J. B. (1981). An hypothesis for a behavioral function of dopaminergic transmission in nucleus accumbens. In R. B. Chronister, & J. F. Defrance (Eds.), The neurobiology of nucleus accumbens. Brunswick, Canada: Huer Institute.
135. Nicola, S. M. (2010). The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the activation of reward-seeking behavior. Journal of Neuroscience, 30, 16585-16600.
136. Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology, 191, 507-520.
137. Nowend, K. L., Arizzi, M., Carlson, B. B., & Salamone, J. D. (2001). D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacology Biochemistry and Behavior, 69, 373-382.
138. Nunes, E. J., Randall, P. A., Santerre, J. L., Given, A. B., Sager, T. N., Correa, M., & Salamone, J. D. (2010). Differential effects of selective adenosine antagonists on the effort-related impairments induced by dopamine D1 and D2 antagonism. Neuroscience, 170, 268-280.
139. Pardo, M., Lopez-Cruz, L., Valverde, O., Ledent, C., Baqi, Y., Müller, C. E., & Salamone, J. D. (submitted for publication). Adenosine A2A receptor antagonism and genetic deletion attenuate the effects of dopamine D2 antagonism on effort-based decision making in mice.
140. Pardo, M., Randall, P. A., Nunes, E. J., Lopez-Cruz, L., Janniere, S., Correa, M., & Salamone, J. D. (2011). Effect of dopamine antagonism on effort-related decision making in rats responding on a progressive ratio/chow feeding concurrent choice task. Neuroscience Meeting Planner. Washington, DC: Society for Neuroscience, Online.
141. Parkinson, J. A., Dalley, J. W., Cardinal, R. N., Bamford, A., Fehnert, B., Lachenal, G., Rudarakanchana, N., Halkerston, K. M., Robbins, T. W., & Everitt, B. J. (2002). Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behavioural Brain Research, 137, 149-163.
142. Paterson, N. E., Balci, F., Campbell, U., Olivier, B. E., & Hanania, T. (2010). The triple reuptake inhibitor DOV216,303 exhibits limited antidepressant-like properties in the differential reinforcement of lowrate 72-second responding assay, likely due to dopamine reuptake inhibition. Journal of Psychopharmacology. online.
143. Pavic, L. (2003). Alterations in brain activation in posttraumatic stress disorder patients with severe hyperarousal symptoms and impulsive aggressiveness. European Archives of Psychiatry and Clinical Neuroscience, 253, 80-83
144. Phan, K. L., Taylor, S. F., Welsh, R. C., Ho, S. H., Britton, J. C., & Liberzon, I. (2004). Neural correlates of individual ratings of emotional salience: a trial-related fMRI study. Neuroimage, 21, 768-780.
145. Phillips, P. E., Walton, M. E., & Jhou, T. C. (2007). Calculating utility: preclinical evidence for costbenefit analysis by mesolimbic dopamine. Psychopharmacology, 191, 483-495.
146. Pinna, A., Wardas, J., Simola, N., & Morelli, M. (2005). New therapies for the treatment of Parkinson's disease: adenosine A2A receptor antagonists. Life Science, 77, 3259-3267.
147. Pitts, S. M., & Horvitz, J. C. (2000). Similar effects of D(1)/D(2) receptor blockade on feeding and locomotor behavior. Pharmacology, Biochemistry and Behavior, 65, 433-438.
148. Pizzagalli, D. A. (2010). The "anhedonia paradox" in schizophrenia: insights from affective neuroscience. Biological Psychiatry, 67, 899-901.
149. Premack, D. (1959). Toward empirical behavior laws. I: Positive reinforcement. Psychological Review, 66, 219- 33.
150. Pruessner, J. C., Champagne, F., Meaney, M. J., & Dagher, A. (2004). Dopamine release in response to a psychological stress in humans and its relationship to early life maternal care: a positron emission tomography study using [11C]raclopride. Journal of Neuroscience, 24, 2825-2831.
151. Rachlin, H. (2003). Economic concepts in the behavioral study of addiction. In R. E. Vuchinich, & N. Heather (Eds.), Choice, behavioral economics and addiction (pp. 129-149). Oxford, U.K.: Elsevier.
152. Randall, P. A., Nunes, E. J., Janniere, S. L., Stopper, C. M., Farrar, A. M., Sager, T. N., Baqi, Y., Hockemeyer, J., Müller, C. E., & Salamone, J. D. (2011). Stimulant effects of adenosine antagonists on operant behavior: differential actions of selective A2A and A1 antagonists. Psychopharmacology, 216, 173-186.
153. Randall, P. A., Pardo, M., Nunes, E. J., Lopez-Cruz, L., Blodgett, A., Lingiah, K., Leser, C., Vemuri, V. K., Makriyannis, A., Baqi, Y., Müller, C. E., Correa, M., & Salamone, J. D. (2011). Effort-related choice behavior as assessed by a progressive ratio/chow feeding task: differential effects of DA D2 antagonism, adenosine A2A antagonism, cannabinoid CB1 antgonism and pre-feeding. Neuroscience Meeting Planner. Washington, DC: Society for Neuroscience, Online.
154. Rick, J. H., Horvitz, J. C., & Balsam, P. D. (2006). Dopamine receptor blockade and extinction differentially affect behavioral variability. Behavioral Neuroscience, 120, 488-492.
155. Robbins, T. W., & Everitt, B. J. (2007). A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology, 191, 433-437.
156. Robbins, T. W., & Koob, G. F. (1980). Selective disruption of displacement behaviour by lesions of the mesolimbic dopamine system. Nature, 285, 409-412.
157. Robbins, T. W., Roberts, D. C., & Koob, G. F. (1983). Effects of d-amphetamine and apomorphine upon operant behavior and schedule-induced licking in rats with 6-hydroxydopamine-induced lesions of the nucleus accumbens. Journal of Pharmacology and Experimental Therapeutics, 224, 662-673.
158. Roitman, M. F., Stuber, G. D., Phillips, P. E., Wightman, R. M., & Carelli, R. M. (2004). Dopamine operates as a subsecond modulator of food seeking. Journal of Neuroscience, 24, 1265-1271.
159. Rolls, E. T., Rolls, B. J., Kelly, P.H., Shaw, S. G., Wood, R. J., & Dale, R. (1974). The relative attenuation of selfstimulation, eating and drinking produced by dopamine receptor blockade. Psychopharmacology, 38, 219-230.
160. Rusk, I. N., & Cooper, S. J. (1994). Parametric studies of selective D1 and D2 antagonists: effects on appetitive and feeding behavior. Behavioral Pharmacology, 5, 615-622.
161. Salamone, J. D. (1986). Different effects of haloperidol and extinction on instrumental behaviours. Psychopharmacology, 88, 18-23.
162. Salamone, J. D. (1987). The actions of neuroleptic drugs on appetitive instrumental behaviors. In L. L. Iversen, S. D. Iversen, & S. H. Snyder (Eds.), Handbook of psychopharmacology (pp. 575-608). New York: Plenum Press.
163. Salamone, J. D. (1988). Dopaminergic involvement in activational aspects of motivation: effects of haloperidol on schedule induced activity, feeding and foraging in rats. Psychobiology, 16, 196-206.
164. Salamone, J. D. (1992). Complex motor and sensorimotor functions of striatal and accumbens dopamine: involvement in instrumental behavior processes. Psychopharmacology, 107 (2-3), 160-74.
165. Salamone, J. D. (1994). The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behavioral Brain Research, 61, 117-133.
166. Salamone, J. D. (1996). The behavioral neurochemistry of motivation: methodological and conceptual issues in studies of the dynamic activity of nucleus accumbens dopamine. Journal of Neuroscience Methods, 64, 137-149.
167. Salamone, J. D. (2006). Will the last person who uses the term 'reward' please turn out the lights? Comments on processes related to reinforcement, learning, motivation, and effort. Addiction Biology, 11 (1), 43-44.
168. Salamone, J. D. (2010a). Involvement of nucleus accumbens dopamine in behavioral activation and effortrelated functions. In L. L. Iversen, S. D. Iversen, S. B. Dunnett, & A. Bjorkland (Eds.), Dopamine handbook. Oxford, UK: Oxford University Press.
169. Salamone, J. D. (2010b). Motor function and motivation. In G. Koob, M. Le Moal, & R. F. Thompson (Eds.), Encyclopedia of behavioral neuroscience, Vol. 3 (pp. 267- 276). Oxford: Academic Press.
170. Salamone, J. D., Aberman, J. E., Sokolowski, J. D., & Cousins, M. S. (1999). Nucleus accumbens dopamine and rate of responding: Neurochemical and behavioral studies. Psychobiology, 27, 236-47.
171. Salamone, J. D., Arizzi, M., Sandoval, M. D., Cervone, K. M., & Aberman, J. E. (2002). Dopamine antagonsts alter response allocation but do not suppress appetite for food in rats: Contrast between the effects of SKF 83566, raclopride and fenfluramine on a concurrent choice task. Psychopharmacology, 160, 371-380.
172. Salamone, J. D., Betz, A. J., Ishiwari, K., Felsted, J., Madson, L., Mirante, B., Clark, K., Font, L., Korbey, S., Sager, T. N., Hockemeyer, J., & Muller, C. E. (2008). Tremorolytic effects of adenosine A2A antagonists: implications for parkinsonism. Frontiers in Biosciences, 13, 3594-3605.
173. Salamone, J. D., & Correa, M. (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behavioural Brain Research, 137 (1-2), 3-25.
174. Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology, 191, 461-482.
175. Salamone, J. D., Correa, M., Farrar, A. M., Nunes, E. J., & Collins, L. E. (2010). Role of dopamine-adenosine interactions in the brain circuitry regulating effortrelated decision making: insights into pathological aspects of motivation. Future Neurology, 5, 377-392.
176. Salamone, J. D., Correa, M., Mingote, S., & Weber, S. M. (2003). Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: implications for studies of natural motivation, psychiatry, and drug abuse. Journal of Pharmacology and Experimental Therapeutics, 305, 1-8.
177. Salamone, J. D., Correa, M., Mingote, S. M., & Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Current Opinion in Pharmacology, 5, 34-41.
178. Salamone, J. D., Correa, M., Mingote, S. M., Weber, S. M., & Farrar, A. M. (2006). Nucleus accumbens dopamine and the forebrain circuitry involved in behavioral activation and effort-related decision making: implications for understanding anergia and psychomotor slowing in depression. Current Psychiatry Reviews, 2, 267-280.
179. Salamone, J. D., Cousins, M. S., & Bucher, S. (1994). Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behavioural Brain Research, 65, 221-229
180. Salamone, J. D., Cousins, M. S., Maio, C., Champion, M., Turski, T., & Kovach, J. (1996). Different behavioral effects of haloperidol, clozapine, and thioridazine in a concurrent lever pressing and feeding procedure. Psychopharmacology, 125, 105-112.
181. Salamone, J. D., Cousins, M. S., & Snyder, B. J. (1997). Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neuroscience and Biobehavioral Reviews, 21, 341-359.
182. Salamone, J. D., Farrar, A. M., Font, L., Patel, V., Schlar, D. E., Nunes, E. J., Collins, L. E., & Sager, T. N. (2009). Differential actions of adenosine A1 and A2A antagonists on the effort-related effects of dopamine D2 antagonism. Behavioural Brain Research, 201, 216-222.
183. Salamone, J. D., Ishiwari, K., Betz, A. J., Farrar, A. M., Mingote, S. M., Font, L., Hockemeyer, J., Müller, C. E., & Correa, M. (2008). Dopamine/adenosine interactions related to locomotion and tremor in animal models: Possible relevance to parkinsonism. Parkinson's Disease and Related Disorders, 14, S130-S134.
184. Salamone, J. D., Kurth, P., McCullough, L. D., & Sokolowski, J. D. (1995). The effects of nucleus accumbens dopamine depletions on continuously reinforced operant responding: contrasts with the effects of extinction. Pharmacology Biochemistry and Behavior, 50, 437-443.
185. Salamone, J. D., Kurth, P. A., McCullough, L. D., Sokolowski, J. D., & Cousins, M. S. (1993). The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding. Brain Research, 628, 218-226.
186. Salamone, J. D., Mahan, K., & Rogers, S. (1993). Ventrolateral striatal dopamine depletions impair feeding and food handling in rats. Pharmacology Biochemistry and Behavior, 44, 605-610.
187. Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., & Mahan, K. (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology, 104, 515-521.
188. Salamone, J. D., Wisniecki, A., Carlson, B. B., & Correa, M. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience, 105, 863-870.
189. Sanchis-Segura, C., & Spanagel, R. (2006). Behavioural assessment of drug reinforcement and addictive features in rodents: an overview. Addiction Biology, 11, 2-38.
190. Sarchiapone, M., Carli, V., Camardese, G., Cuomo, C., Di Guida, D., Calgagni, M. L., Focacci, C., & De Riso, S. (2006). Dopamine transporter binding in depressed patients with anhedonia. Psychiatric Research: Neuroimaging, 147, 243-248.
191. Schiffmann, S. N., Jacobs, O., & Vanderhaeghen, J. J. (1991). Striatal restricted adenosine A2A receptor (RDC8) is expressed by enkephalin but not by substance P neurons: an in situ hybridization histochemistry study. Journal of Neurochemistry, 57, 1062- 1071.
192. Schmelzeis, M. C., & Mittleman, G. (1996). The hippocampus and reward: effects of hippocampal lesions on progressive-ratio responding. Behavioral Neuroscience, 110, 1049-1066.
193. Schoenbaum, G., & Setlow, B. (2003). Lesions of nucleus accumbens disrupt learning about aversive outcomes. Journal of Neuroscience, 23, (30), 9833-9841.
194. Schultz, W. (2007a). Multiple dopamine functions at different time courses. Annual Review of Neuroscience, 30, 259-288.
195. Schultz, W. (2007b). Behavioral dopamine signals. Trends in Neurosciences, 30, 203-210.
196. Schwab, R. S. (1972). Akinesia paradoxica. Electroencephalography and Clinical Neurophysiology, 31, 87-92.
197. Schweimer, J., & Hauber, W. (2006). Dopamine D1 receptors in the anterior cingulate cortex regulate effort-related decision making. Learning and Memory, 13, 777-782.
198. Segovia, K. N., Correa, M., & Salamone, J. D. (2011). Slow phasic changes in nucleus accumbens dopamine release during fixed ratio acquisition: a microdialysis study. Neuroscience, 196, 188-198.
199. Sink, K. S., Vemuri, V. K., Olszewska, T., Makriyannis, A., & Salamone, J. D. (2008). Cannabinoid CB1 antagonists and dopamine antagonists produce different effects on a task involving response allocation and effortrelated choice in food-seeking behavior. Psychopharmacology, 196, 565-574.
200. Skinner, B. F. (1953). Science and human behavior. New York: Macmillan.
201. Skjoldager, P., Pierre, P. J., & Mittlman, G. (1993). Reinforcer magnitude and progressive ratio responding: Effects of increased effort, prefeeding and extinction. Learning and Motivation, 24, 303-343.
202. Sokolowski, J. D., Conlan, A. N., & Salamone, J. D. (1998). A microdialysis study of nucleus accumbens core and shell dopamine during operant responding in the rat. Neuroscience, 86, 1001-1009.
203. Sokolowski, J. D., & Salamone, J. D. (1998). The role of nucleus accumbens dopamine in lever pressing and response allocation: Effects of 6-OHDA injected into core and dorsomedial shell. Pharmacology Biochemistry Behavior, 59, 557-566.
204. Spivak, K. J., & Amit, Z. (1986). Effects of pimozide on appetitive behavior and locomotor activity: Dissimilarity of effects when compared to extinction. Physiological Behavior, 36, 457-463.
205. Staddon, J. E. R. (1979). Operant behavior as adaptation to constraint. Journal of Experimental Psychology: General, 108, 48-67.
206. Staddon, J. E. R., & Ettenger, R. H. (1989). Learning: An introduction to the principles of adaptive behavior. New York: Harcourt Brace Jovanovitch.
207. Stahl, S. M. (2002). The psychopharmacology of energy and fatigue. Journal of Clinical Psychiatry, 63, 7-8.
208. Stewart, W. J. (1975). Progressive reinforcement schedules: A review and evaluation. Australian Journal of Psychology, 27, 9-22.
209. Svenningsson, P., Le Moine, C., Fisone, G., & Fredholm, B. B. (1999). Distribution, biochemistry and function of striatal adenosine A2A receptors. Progress in Neurobiology, 59, 355-396.
210. Takahashi, R. N., Pamplona, F. A., & Prediger, R. D. (2008). Adenosine receptor antagonists for cognitive dysfunction: a review of animal studies. Frontiers in Bioscience, 13, 2614-2632.
211. Tapp, J. T. (1969). Activity, reactivity, and the behaviordirecting properties of stimuli. In J. T. Tapp (Ed.), Reinforcement and behavior (pp. 387-416). New York: Academic Press.
212. Timberlake, W. (1993). Behavior systems and reinforcement: An integrative approach. Journal of the Experimental Analysis of Behavior, 60, 105-128.
213. Treadway, M. T., & Zald, D. H. (2011). Reconsidering anhedonia in depression: Lessons from translational neuroscience. Neuroscience and Biobehavioral Reviews, 35, 537-555.
214. Tustin, R. D. (1995). Assessing preference for reinforcers using demand curves, work-rate functions, and expansion paths. Journal of the Experimental Analysis of Behavior, 64, 313-329.
215. Ungerstedt, U. (1971). Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system. Acta Physiologica Scandinavia Supplementum, 367, 95-122.
216. Van den Bos, R., van der Harst, J., Jonkman, S., Schilders, M., & Spruijt, B. (2006). Rats assess costs and benefits according to an internal standard. Behavioural Brain Research, 171, 350-354.
217. Venugopalan, V. V., Casey, K. F., O'Hara, C., O'Loughlin, J., Benkelfat, C., Fellows, L. K., & Leyton, M. (2011). Acute phenylalanine/tyrosine depletion reduces motivation to smoke cigarettes across stages of addiction. Neuropsychopharmacology, 36, 2469-2476.
218. Vezina, P., Lorrain, D. S., Arnold, G. M., Austin, J. D., & Suto, N. (2002). Sensitization of midbrain dopamine neuron reactivity promotes the pursuit of amphetamine. The Journal of Neuroscience, 22, 4654-4662.
219. Vuchinich, R. E., & Heather, N. (2003). Introduction: Overview of behavioural economic perspectives on substance use and addiction. In R. E. Vuchinich, & N. Heather (Eds.), Choice, behavioral economics and addiction (pp. 1-31). Oxford, U.K.: Elsevier.
220. Wachtel, S. R., Ortengren, A., & de Wit, H. (2002). The effects of acute haloperidol or risperidone on subjective responses to methamphetamine in healthy volunteers. Drug and Alcohol Dependence, 68, 23-33.
221. Wade, T. R., de Wit, H., & Richards, J. B. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology, 150, 90-101.
222. Wakabayashi, K. T., Fields, H. L., & Nicola, S. M. (2004). Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behavioural Brain Research, 154, 19-30.
223. Wallace, M., Singer, G., Finlay, J., & Gibson, S. (1983). The effect of 6-OHDA lesions of the nucleus accumbens septum on schedule-induced drinking, wheelrunning and corticosterone levels in the rat. Pharmacology, Biochemistry, and Behavior, 18, 129-136.
224. Walton, M. E., Bannerman, D. M., Alterescu, K., & Rushworth, M. F. S. (2003). Functional specialization within medial frontal cortex of the anterior cingulated for evaluating effort-related decisions. Journal of Neuroscience, 23, 6475-6479.
225. Walton, M. E., Bannerman, D. M., & Rushworth, M. F. (2002). The role of rat medial frontal cortex in effortbased decision making. Journal of Neuroscience, 22, 10996-11003.
226. Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E., & Rushworth, M. F. (2006). Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Network, 19, 1302-1314.
227. Ward, S. J., Morgan, D., & Roberts, D. C. (2005). Comparison of the reinforcing effects of cocaine and cocaine/heroin combinations under progressive ratio and choice schedules in rats. Neuropsychopharmacology, 30, 286-295.
228. Wardas, J., Konieczny, J., & Lorenc-Koci, E. (2001). SCH 58261, an A2A adenosine receptor antagonist, counteracts parkinsonian-like muscle rigidity in rats. Synapse, 41, 160-171.
229. Weinstock, L. M., Munroe, M. K., & Miller, I. W. (2011). Behavioral activation for the treatment of atypical depression: a pilot open trial. Behavior Modification, 35, 403-424.
230. Williams, B. A. (1988). Reinforcement, choice, and response strength. In R. C. Atkinson, R. J. Herrnstein, G. Lindsey, & R. D. Luce (Eds.), Stevens' handbook of experimental psychology, vol. 2 (pp. 167-174). New York: John Wiley and Sons.
231. Willner, P., Chawala, K., Sampson, D., Sophokleous, S., & Muscat, R. (1988). Tests of function equivalence between pimozide pretreatment, extinction and free feeding. Psychopharmacology, 95, 423-426.
232. Winstanley, C. A., Theobald, D. E. H., Dalley, J. W., & Robbins, T. W. (2005). Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacology, 30, 669-682.
233. Wirtshafter, D., & Asin, K. E. (1985). Haloperidol and nonreinforcement produce different patterns of response slowing in a food reinforced runway task. Pharmacology, Biochemistry, and Behavior, 22, 661-663.
234. Wise, R. A. (2004). Dopamine, learning and motivation. Nature Reviews in Neuroscience, 5, 483-494.
235. Wise, R. A., Spindler, J., de Wit, H., & Gerberg, G. J. (1978). Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science, 201, 262-264.
236. Woolverton, W. L., & Ranaldi, R. (2002). Comparison of the reinforcing efficacy of two dopamine D2-like receptor agonists in rhesus monkeys using a progressive-ratio schedule of reinforcement. Pharmacology, Biochemistry, and Behavior, 72, 803-809.
237. Worden, L. T., Shahriari, M., Farrar, A. M., Sink, K. S., Hockemeyer, J., Müller, C., & Salamone, J. D. (2009). The adenosine A2A antagonist MSX-3 reverses the effort-related effects of dopamine blockade: differential interaction with D1 and D2 family antagonists. Psychopharmacology, 203, 489-499.
238. Wyvell, C. L., & Berridge, K. C. (2001). Incentive sensitization by previous amphetamine exposure: increased cue-triggered "wanting" for sucrose reward. Journal of Neuroscience, 21, 7831-7840.
239. Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008). Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. European Journal of Neuroscience, 28, 1437-1448.
240. Young, A. M. (2004). Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats. Journal of Neuroscience Methods, 138, 57-63.