Motivational views of reinforcement: Implications for understanding the behavioral functions of nucleus accumbens dopamine

Behavioural Brain Research

Volumn 137, Issue 1-2, 2002, Pages 3-25

  Salamone, John D ^a   Correa, Mercè ^a  

^a UNIVERSITY OF CONNECTICUT   (United States)

Author keywords

Activation; Ergonomics; Fatigue; Incentive salience; Motivation; Reward; Striatum

Indexed keywords

8 BROMO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL; 8 CHLORO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE; AMPHETAMINE; DOPAMINE; DOPAMINE RECEPTOR BLOCKING AGENT; FENFLURAMINE; FLUPENTIXOL; HALOPERIDOL; OXIDOPAMINE; RACLOPRIDE; SULPIRIDE;

APPETITE; ARTICLE; BEHAVIOR; CONCENTRATION RESPONSE; DOPAMINE BRAIN LEVEL; DOPAMINERGIC SYSTEM; DRUG ABUSE; DRUG EFFECT; FOOD INTAKE; HUMAN; HYPOTHESIS; LEARNING; MOTIVATION; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; REINFORCEMENT; REWARD; STIMULUS;

ANIMALS; APPETITE; CONDITIONING, OPERANT; CORPUS STRIATUM; DOPAMINE; DOPAMINE AGONISTS; DOPAMINE ANTAGONISTS; MOTIVATION; NUCLEUS ACCUMBENS; RATS; REINFORCEMENT (PSYCHOLOGY);

EID: 0037010742     PISSN: 01664328     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0166-4328(02)00282-6     Document Type: Article

References (228)

1. Aberman J.E., Salamone J.D. Nucleus accumbens dopamine depletions make animals more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience. 92:1999;545-552.
2. Aberman J.E., Ward S.J., Salamone J.D. Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive ratio performance. Pharmacol. Biochem. Behav. 61:1998;341-348.
3. Ackroff K., Sclafani A. Palatability and foraging cost interact to control caloric intake. J. Exp. Psychol. Anim. Behav. Proc. 25:1999;28-36.
4. Acquas E., Carboni E., Leone P., Di Chiarra G. SCH 23390 blocks drug-conditioned place-preference and place aversion: anhedonia (lack of reward) or apathy (lack of motivation) after dopamine receptor blockade. Psychopharmacology. 99:1989;151-155.
5. Agmo A., Galvan A., Talamantes B. Reward and reinforcement produced by drinking sucrose: two processes that may depend on different neurotransmitters. Pharmacol. Biochem. Behav. 52:1995;403-414.
6. Allison J. Response deprivation, reinforcement and economics. J. Exp. Anal. Behav. 60:1993;129-140.
7. Amsel A., Rashotte M.E. Mechanisms of adaptive behavior: Clark L. Hull's theoretical papers, with commentary. 1984;Columbia University Press, New York.
8. Anisman H., Corradini A., Tombaugh T.N., Zacharko R.M. Avoidance performance, cue and response-choice discrimination after neuroleptic treatment. Pharmacol. Biochem. Behav. 17:1982;1245-1249.
9. Aparicio C. Assessing haloperidol in rats with the barrier choice paradigm. Suma Psicologica. 5:1998;1-20.
10. Bakshi V.P., Kelley A.E. Dopaminergic regulation of feeding behavior: I. Differential effects of haloperidol microinjection in three striatal subregions. Psychobiology. 19:1991;223-232.
11. Baldo BA, Sadeghian K, Basso AM, Kelley AE. Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on injestive behavior and associated motor activity, Behav Brain Res, this issue.
12. Bartus R.T. Short-term memory in the rhesus monkey: effects of dopamine blockade via acute haloperidol administration. Pharmacol. Biochem. Behav. 9:1978;353-357.
13. Baum W.M., Rachlin H.C. Choice as time allocation. J. Exp. Anal. Behav. 12:1969;861-874.
14. Beninger R.J., Miller R. Dopamine D1-like receptors and reward-related incentive learning. Neurosci. Biobehav. Rev. 22:1998;335-345.
15. Beninger R.J., Ranaldi R. Microinjections of flupenthixol into the caudate-putamen but not the nucleus accumbens, amygdala or frontal cortex of rats produce intra-session declines in food-rewarded operant responding. Behav. Brain Res. 55:1993;203-212.
16. Berridge K.C. Brain substrates of liking and wanting. Neurosci. Biobehav. Rev. 20:1995;1-25.
17. Berridge K.C. Measuring hedonic impact in animals and infants: microstructure of affective taste reactivity patterns. Neurosci. Biobehav. Rev. 24:2000;173-198.
18. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning or incentive salience. Brain Res. Rev. 28:1998;309-369.
19. Berridge K.C., Venier I.L., Robinson T.E. Taste reactivity analysis of 6-hydroxydopamine-induced aphagia: implications for arousal and anhedonia hypotheses of dopamine function. Behav. Neurosci. 103:1989;36-45.
20. Bickel W.K., Marsch L.A., Carroll M.E. Deconstructing relative reinforcement efficacy and situating the measures of pharmacological reinforcement with behavioral economics: a theoretical proposal. Psychopharmacology. 153:2000;44-56.
21. Bindra D. How adaptive behavior is produced: a perceptual-motivational alternative to response-reinforcement. Behav. Brain Sci. 1:1978;41-91.
22. Blundell J.E. Structure, process and mechanism: case studies in the psychopharmacology of feeding. Iversen L.L., Iversen S.D., Snyder S.H., Handbook of psychopharmacology. 19:1987;123-182 Plenum Press, New York.
23. Bowers W., Hamilton M., Zacharcho R.M., Anisman H. Differential effects of pimozide on response-rate and choice accuracy in a self-stimulation paradigm in mice. Pharmacol. Biochem. Behav. 22:1985;521-526.
24. Brauer L.H., De Wit H. High dose pimozide does not block amphetamine-induced euphoria in normal volunteers. Pharmacol. Biochem. Behav. 56:1997;265-272.
25. Buchwald N.A., Hull C.D., Levine M.S., Villablanca J. The basal ganglia and the regulation of response and cognitive sets. Brazier M.A., Growth and development of the brain. 1975;171-189 Raven Press, New York.
26. Caine S.B., Koob G.F. Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food. J. Exp. Anal. Behav. 61:1994;213-221.
27. Cardinal RN, Parkinson JA, Hall J, Everitt BJ. Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex, Neurosci Biobehav Rev, 2002;26:321-52.
28. Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ. Impulsive choice induced in rats by lesions of the nucleus accumbens core, Science, 2001;292:2499-501.
29. Carlson N.R. Foundations of physiological psychology. 1999;Allyn and Bacon, Boston.
30. Caul W.F., Brindle N.A. Schedule-dependent effects of haloperidol and amphetamine: multiple-schedule task shows within-subject effects. Pharmacol. Biochem. Behav. 68:2001;53-63.
31. Chausmer A.L., Ettenberg A. A role for D2, but not D1, dopamine receptors in the response-reinstating effects of food reinforcement. Pharmacol. Biochem. Behav. 57:1997;681-685.
32. Chausmer A.L., Ettenberg A. Intraacumbens raclopride attenuates amphetamine-induced locomotion, but fails to prevent the response-reinstating properties of food reinforcement. Pharmacol. Biochem. Behav. 62:1999;299-305.
33. Clifton P.G., Rusk I.N., Cooper S.J. Effects of dopamine D1 and dopamine D2 antagonists on the free feeding and drinking patterns of rats. Behav. Neurosci. 105:1991;272-281.
34. Cofer C.N. Motivation and emotion. 1972;Scott, Foresman, Glenview, IL.
35. Cofer C.N., Appley M.H. Motivation: theory and research. 1964;Wiley, New York.
36. Colwill R.M., Rescorla R.A. Associative structures in instrumental learning. Bower G.H., The psychology of learning and motivation. 1986;55-104 Academic Press, New York.
37. Collier G.H., Jennings W. Work as a determinant of instrumental performance. J. Comp. Physiol. Psychol. 68:1969;659-662.
38. Collier G.H., Johnson D.F., Hill W.L., Kaufman L.W. The economics of the law of effect. J. Exp. Anal. Behav. 46:1986;113-136.
39. Cooper S.J., Francis J. A microstructural analysis of the effects of presatiation on feeding behavior in the rat. Physiol. Behav. 53:1993;413-419.
40. Cooper S.J., Sweeny K.F. Effects of spiperone alone and in combination with anorectic agents on feeding parameters in the rat. Neuropharmacology. 19:1980;997-1003.
41. Correa M, Carlson BB, Wisniecki A, Salamone JD. Nucleus accumbens dopamine and work requirements on interval schedules, Behav Brain Res, this issue.
42. Cousins M.S., Atherton A., Turner L., Salamone J.D. Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behav. Brain Res. 74:1996;189-197.
43. Cousins M.S., Salamone J.D. Involvement of ventrolateral striatal dopamine in movement initiation and execution: a microdialysis and behavioral investigation. Neuroscience. 70:1996;849-859.
44. Cousins M.S., Salamone J.D. Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit paradigm. Pharmacol. Biochem. Behav. 49:1994;85-91.
45. Cousins M.S., Sokolowski J.D., Salamone J.D. Different effects of nucleus accumbens and ventrolateral striatal dopamine depletions on instrumental response selection in the rat. Pharmacol. Biochem. Behav. 46:1993;943-951.
46. Cousins M.S., Trevitt J., Atherton A., Salamone J.D. Different behavioral functions of dopamine in nucleus accumbens and ventrolateral striatum: a microdialysis and behavioral investigation. Neuroscience. 91:1999;925-934.
47. Cousins M.S., Wei W., Salamone J.D. Pharmacological characterization of performance on a concurrent lever pressing/feeding choice procedure: effects of dopamine antagonist, cholinomimetic, sedative and stimulant drugs. Psychopharmacology. 116:1994;529-537.
48. Dackis C.A., O'Brien C.P. Cocaine dependence: a disease of the brain's reward centers. J. Subst. Abuse Treat. 21:2001;111-117.
49. Das S., Fowler S.C. An update of Fowler and Das: anticholinergic reversal of haloperidol-induced, within-session decrements in rats' lapping behavior. Pharmacol. Biochem. Behav. 53:1996;853-855.
50. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim. Learn. Behav. 22:1994;1-18.
51. Di Chiara G., Imperato A. Preferential stimulation of dopamine release in the nucleus accumbens by opiates, alcohol, and barbiturates: studies with transcerebral dialysis in freely moving rats. Annal. New York Acad. Sci. 473:1986;367-381.
52. DiChiara G. Nucleus accumbens shell dopamine and Pavlovian incentive learning: Role in motivation and addiction, Behav Brain Res, in press.
53. DiScala G., Sandner G. Conditioned place aversion produced by FG 7142 is attenuated by haloperidol. Psychopharmacology. 99:1989;176-180.
54. Domjan M., Burkhard B. The principles of learning and behavior. 1986;Brooks/Cole Publishing, Monterey, CA.
55. Duffy E. Activation and behavior. 1963;Wiley, New York.
56. Dunnett S.B., Iversen S.D. Regulatory impairments following selective 6-OHDA lesions of the neostriatum. Behav. Brain Res. 4:1982;195-202.
57. Dworkin S.I., Guerin G.F., Co C., Goeders N.E., Smith J.E. Lack of an effect of 6-hydroxydopamine lesions of the nucleus accumbens on intravenous morphine self-administration. Pharmacol. Biochem. Behav. 30:1988;1051-1057.
58. Ettenberg A., Koob G.F., Bloom F. Response artifact in the measurement of neuroleptic-induced anhedonia. Science. 209:1981;357-359.
59. Evenden J.L., Robbins T.W. Dissociable effects of D-amphetamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology. 79:1983;180-186.
60. Everitt B.J., Cador M., Robbins T.W. Interactions between the amygdala and ventral striatum in stimulus-reward association: studies assessing a second-order schedule of sexual reinforcement. Neuroscience. 30:1989;63-75.
61. Everitt B.J., Dickinson A., Robbins T.W. The neuropsychological basis of addictive behavior. Brain Res. Rev. 36:2001;129-138.
62. Everitt B.J., Parkinson J.A., Olmstead M.C., Arroyo M., Robledo P., Robbins T.W. Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Annal. New York Acad. Sci. 877:1999;412-438.
63. Fibiger H.C., Carter D.A., Phillips A.G. Decreased intracranial self-stimulation after neuroleptics or 6-hydroxydopamine: evidence for mediation by reward deficits rather than by reduced reward. Psychopharmacology. 47:1976;21-27.
64. Finn M., Jassen A., Baskin P., Salamone J.D. Tremulous characteristics of the jaw movements induced by pilocarpine and ventrolateral striatal dopamine depletions. Pharmacol. Biochem. Behav. 57:1997;243-249.
65. Fowler S.C., Das S. Haloperidol-induced decrements in force and duration of rats tongue movements during licking are attenuated by concomitant anticholinergic treatment. Pharmacol. Biochem. Behav. 49:1994;813-817.
66. Fowler S.C., Mortell C. Low doses of haloperidol interfere with rat tongue extensions during licking: a quantitative analysis. Behav. Neurosci. 106:1992;1-9.
67. Gannon K.N., Smith H.V., Tierney K.J. Effects of procurement cost on food consumption in rats. Physiol. Behav. 31:1983;331-337.
68. Gardner E.L. Brain reward mechanisms. Lowinson J.H., Ruiz P., Millman R.B., Substance abuse. 1992;70-99 Williams & Wilkins, New York.
69. Garris PA, Rebec GV. Modeling fast dopamine neurotransmission in the nucleus accumbens during behavior, Behav Brain Res, this issue.
70. Gawin F.H. Neuroleptic reduction of cocaine-induced paranoia but not euphoria. Psychopharmacology. 90:1986;142-143.
71. Glickman S.E., Schiff B.B. A biological theory of reinforcement. Psychol. Rev. 74:1967;81-109.
72. Gramling S.E., Fowler S.C., Collins K.R. Some effects of pimozide on nondeprived rats licking sucrose solutions in an anhedonia paradigm. Pharmacol. Biochem. Behav. 21:1984;617-624.
73. Gramling S.E., Fowler S.C., Tizzano J.P. Some effects of pimozide on nondeprived rats lever pressing maintained by a sucrose reward in an anhedonia paradigm. Pharmacol. Biochem. Behav. 27:1987;67-72.
74. Gramling S.E., Fowler S.C. Effects of neuroleptics on rate and duration of operant versus reflexive licking in rats. Pharmacol. Biochem. Behav. 22:1985;541-545.
75. Gray J.A., Kumari V., Lawrence N., Young A.M. Functions of the dopaminergic innervation of the nucleus accumbens. Psychobiology. 27:1999;225-235.
76. Gray T., Wise R.A. Effects of pimozide on lever-pressing behavior maintained on an intermittent reinforcement schedule. Pharmacol. Biochem. Behav. 12:1980;931-935.
77. Gunne L.M., Anggard E., Jonsson L.E. Clinical trials with amphetamine-blocking drugs. Psychiatr. Neurol. Neurosurg. 75:1972;225-226.
78. Haase H.J., Janssen P.A.J. The action of neuroleptic drugs. 1985;Elsevier, Amsterdam.
79. Haney M., Ward A.S., Foltin R.W., Fischman M.W. Effects of ecopipam, a selective dopamine D1 antagonist, on smoked cocaine self-administration by humans. Psychopharmacology. 155:2001;330-337.
80. Harvey J.A., Gormezano I. Effects of haloperidol and pimozide on classical conditioning of the rabbit nictitating membrane response. J. Pharmacol. Exp. Ther. 218:1981;712-719.
81. Hinde R.A. Animal behavior: a synthesis of ethology and comparative psychology. 1970;McGraw Hill, New York.
82. Hoebel B.G. Neuroscience and motivation: pathways and peptides that define motivational systems. Atkinson R.C., Herrnstein R.J., Lindzey G., Luce R.D., Stevens handbook of experimental psychology. 1:1988;527-625 Wiley, New York.
83. Horvitz J.C., Ettenberg A. Haloperidol blocks the response-reinstating effects of food reward: a methodology for separating neuroleptic effects on reinforcement and motor processes. Pharmacol. Biochem. Behav. 31:1989;861-865.
84. Horvitz J.C., Richardson W.B., Ettenberg A. Dopamine receptor blockade and reductions in thirst produce different effects on drinking behavior. Pharmacol. Biochem. Behav. 45:1993;725-728.
85. Horvitz JC. Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum, Behav Brain Res, this issue.
86. Hsiao S., Chen B.H. Complex response competition and dopamine blocking: choosing of high cost sucrose solution vs. low cost water solution in rats. Chin. J. Physiol. 38:1995;99-109.
87. Hsiao S., Smith G.P. Raclopride reduces sucrose preference in rats. Pharmacol. Biochem. Behav. 50:1995;121-125.
88. Hull C.L. Principles of behavior. 1943;Appleton-Century-Crofts, New York.
89. Hull E.M., Weber M.S., Eaton R.C., Dua R., Markowski V.P., Lumley L., Moses J. Dopamine receptors in the ventral tegmental area affect motor, but not motivational or reflexive, components of copulation in male rats. Brain Res. 554:1991;72-76.
90. Hursh S.R. Behavioral economics. J. Exp. Anal. Behav. 42:1990;435-452.
91. Hursh S.R., Raslear T.G., Shurtleff D., Bauman R., Simmons L. A cost-benefit analysis of demand for food. J. Exp. Anal. Behav. 30:1988;419-440.
92. Ikemoto S., Panksepp J. Dissociations between appetitive and consummatory responses by phamacological manipulations of reward-relevant brain regions. Behav. Neurosci. 110:1996;331-345.
93. Ikemoto S., Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31:1999;6-41.
94. Janssen P.A.J., Niemegeers C.J.E., Schellekens K.H.L. Is it possible to predict the clinical effects of neuroleptic drugs (major tranquillisers) from animal data. Arzneimittel Forschung. 15:1965;104-117.
95. Jicha G.A., Salamone J.D. Vacuous jaw movements and feeding deficits in rats with ventrolateral striatal dopamine depletions: possible relation to parkinsonian symptoms. J. Neurosci. 11:1991;3822-3829.
96. Johnson P.I., Parente M.A., Stellar J.R. NMDA-induced lesions of the nucleus accumbens or the ventral pallidum increase the rewarding efficacy of food deprived rats. Brain Res. 722:1996;109-117.
97. Jones D.L., Mogenson G.L. Oral motor performance following central dopamine receptor blockade. Eur. J. Pharmacol. 59:1979;11-21.
98. Kaufman L.W. Foraging costs and meal patterns in ferrets. Physiol. Behav. 25:1980;139-141.
99. Keefe K.A., Salamone J.D., Zigmond M.J., Stricker E.M. Paradoxical kinesia in Parkinsonism is not caused by dopamine release: studies in an animal model. Arch. Neurol. 46:1989;1070-1075.
100. Kelley A.E., Delfs J.M. Dopamine and conditioned reinforcement II. Contrasting effects of amphetamine microinjection into the nucleus accumbens with peptide microinjection into the ventral tegmental area. Psychopharmacology. 103:1991;197-203.
101. Kelley A.E., Stinus L. Disappearance of hoarding behavior after 6-hydroxydopamine lesions of the mesolimbic dopamine neurons and its reinstatement with L-DOPA. Behav. Neurosci. 99:1985;531-535.
102. Kelley A.E. Neural integrative activities of nucleus accumbens subregions in relation to learning and motivation. Psychobiology. 27:1999;198-213.
103. Killeen P. Incentive theory. Bernstein D., Response structure and organization. 1981;University of Nebraska Press, Lincoln, NE.
104. Killeen P. On the temporal control of behavior. Psychol. Rev. 82:1975;89-115.
105. Killeen P.R. Economics, ecologics, and mechanics: the dynamics of responding under conditions of varying motivation. J. Exp. Anal. Behav. 64:1995;405-431.
106. Killeen P., Hanson S., Osbourne S. Arousal: its genesis and manifestation as response rate. Psychol. Rev. 85:1978;571-581.
107. Kim J.S., Levin E.D. Nicotinic, muscarinic and dopaminergic actions in the ventral hippocampus and the nucleus accumbens: effects on spatial working memory in rats. Brain Res. 725:1996;231-240.
108. Kirkpatrick M.A., Fowler S.C. Force-proportional reinforcement: pimozide does not reduce rats' emmission of higher forces for sweeter rewards. Pharmacol. Biochem. Behav. 32:1989;499-504.
109. Kiyatkin EA. Dopamine in the nucleus accumbens: Cellular actions, drug- and behavior-associated fluctuations, and a possible role in the organism's adaptive activity, Behav Brain Res, this issue.
110. Koch M., Schmid A., Scnhnitzler H.U. Role of nucleus accumbens dopamine D1 and D2 receptors in instrumental and pavlovian paradigms of conditioned reward. Psychopharmacology. 152:2000;67-73.
111. Koob G.F., Riley S.J., Smith S.C., Robbins T.W. Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi and olfactory tubercle on feeding, locomotor activity, and amphetamine anorexia in the rat. J. Comp. Physiol. Psychol. 92:1978;917-927.
112. Koob G.F., Stinus L., Le Moal M. Hyperactivity and hypoactivity produced by lesions to the mesolimbic dopamine system. Behav. Brain Res. 3:1981;341-359.
113. Koob G.F., Swerdlow N.R. The functional output of the mesolimbic dopamine system. Ann. New York Acad. Sci. 537:1988;216-227.
114. Kosobud A.E., Harris G.C., Chapin J.K. Behavioral associations of neuronal activity in the ventral tegmental area of the rat. J. Neurosci. 14:1994;7117-7129.
115. Krebs J.R. Optimal foraging: decision rules for predators. Krebs J.R., Davies W.B., Behavioral ecology. 1978;Sinauer Associates, Sunderland, MA.
116. Krebs J.R. Optimal foraging: theory and experiment. Nature. 268:1977;583-584.
117. Lea S.E.G. The psychology and economics of demand. Psychol. Bull. 85:1978;441-466.
118. Liao R.M., Fowler S.C. Haloperidol produces within-session increments in operant response duration in rats. Pharmacol. Biochem. Behav. 36:1990;199-201.
119. Lidsky T.I., Buchwald N.A., Manetto C., Schneider J.S. A consideration of sensory factors involved in the motor functions of the basal ganglia. Brain Res. Rev. 9:1985;133-146.
120. Ljungberg T. Blockade by neuroleptics of water intake and operant responding in the rat: anhedonia, motor deficit or both. Pharmacol. Biochem. Behav. 27:1987;341-350.
121. Ljungberg T. Differential attenuation of water intake and water-rewarded operant responding by repeated administration of haloperidol and SCH 23390 in the rat. Pharmacol. Biochem. Behav. 35:1990;111-115.
122. Ljungberg T. Scopolamine reverses haloperidol-attenuated lever pressing for water but not haloperidol-attenuated water intake in the rat. Pharmacol. Biochem. Behav. 29:1988;205-211.
123. Marinelli M., Barrot M., Simon H., Oberlander C., Dekeyne A., Le Moal M., Piazza P.V. Pharmacological stimuli decreasing nucleus accumbens dopamine can act as positive reinforcers but have a low addictive potential. Eur. J. Neurosci. 10:1998;3269-3275.
124. Marshall J.F., Richardson J.S., Teitelbaum P. Nigrostriatal bundle damage and the lateral hypothalamic syndrome. J. Comp. Physiol. Psychol. 87:1974;808-830.
125. Martin-Iverson M.T., Wilke D., Fibiger H.C. Effect of haloperidol and D-amphetamine on perceived quantity of food and tones. Psychopharmacology. 93:1987;374-381.
126. Mason S.T., Beninger R.J., Fibiger H.C., Phillips A.G. Pimozide-induced suppression of responding: evidence against a block of food reward. Pharmacol. Biochem. Behav. 12:1980;917-923.
127. McCullough L.D., Cousins M.S., Salamone J.D. The role of nucleus accumbens dopamine in responding on a continuous reinforcement operant schedule: a neurochemical and behavioral study. Pharmacol. Biochem. Behav. 46:1993;581-586.
128. McCullough L.D., Salamone J.D. Anxiogenic drugs beta-CCE and FG 7142 increase extracellular dopamine levels in the nucleus accumbens. Psychopharmacology. 109:1992;379-382.
129. McCullough L.D., Salamone J.D. Involvement of nucleus accumbens dopamine in the motor activity induced by periodic food presentation: a microdialysis and behavioral study. Brain Res. 592:1992;29-36.
130. McCullough L.D., Sokolowsi J.D., Salamone J.D. A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience. 52:1993;919-925.
131. McFarland K., Ettenberg A. Haloperidol does not affect motivational processes in an operant runway model of food-seeking behavior. Behav. Neurosci. 112:1998;630-635.
132. McGeorge AJ, Faull RLM. The organization of the projection from the cerebral cortex to the striatum in the rat, Neuroscience 29:503-37.
133. Mobini S., Chiang T.J., Ho M.Y., Bradshaw C.M., Szabadi E. Comparison of the effects of clozapine, haloperidol, chlorpromazine and D-amphetamine on performance on a time-constrained progressive ratio schedule and on locomotor behavior in the rat. Psychopharmacology. 152:2000;47-54.
134. Mogenson G., Jones D., Yim C.Y. From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14:1980;69-97.
135. Muscat R., Willner P. Effects of dopamine receptor antagonists on sucrose consumption and preference. Psychopharmacology. 99:1989;98-102.
136. Nader K., Bechara A., van der Kooy D. Neurobiological constraints on behavioral models of motivation. Annu. Rev. Psychol. 48:1997;85-114.
137. Nann-Vernotica E., Donny E.C., Bigelow G.E., Walsh S.L. Repeated administration of the D1/5 antagonist ecopipam fails to attenuate subjective effects of cocaine. Psychopharmacology. 155:2001;338-347.
138. Neafsy E.J., Hull C.D., Buchwald N.A. Preparation for movement in the cat. II. Unit activity in the basal ganglia and thalamus. Electroencephalogr. Clin. Neurophysiol. 44:1978;714-723.
139. Neill D.B., Justice J.B. An hypothesis for a behavioral function of dopaminergic transmission in nucleus accumbens. Chronister R.B., Defrance J.F., The neurobiology of the nucleus accumbens. 1981;Huer Institute, Brunswick, Canada.
140. Neill DB, Fenton H, Justice JB. Increase in accumbal dopaminergic transmission correlates with response cost not reward of rewarding hypothalamic stimulation, Behav Brain Res, this issue.
141. Nowend K.L., Arizzi M.N., Carlson B.B., Salamone J.D. D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol. Biochem. Behav. 69:2001;373-382.
142. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, Lachenal G, Rudarakanchana GN, Halkerston KM, Robbins TW, Everitt BJ. Nucleus accumbens dopamine depletion impairs both acquisistion and performance of appetitive Pavlovian approach behavior: Implications for mesoaccumbens dopamine function, Behav Brain Res, this issue.
143. Parkinson J.A., Fudge J., Hurd Y., Pennartz C., Peoples L. Finding motivation at Seabrook Island: the ventral striatum, learning, and plasticity. Trends Neurosci. 23:2000;383-384.
144. Parkinson J.A., Robbins T.W., Everitt B.J. Selective excitotoxic lesions of the nucleus accumbens core and shell differentially affect aversive Pavlovian conditioning to discrete and contextual cues. Psychobiology. 27:1999;256-266.
145. Pecoraro N.C., Timberlake W.D., Tinsley M. Incentive downshifts evoke search repertoires in rats. J. Exp. Psychol. Anim. Behav. Proc. 25:1999;153-167.
146. Pitts S.M., Horvitz J.C. Similar effects of D1/D2 receptor blockade on feeding and locomotor activity. Pharmacol. Biochem. Behav. 65:2000;433-438.
147. Premack D. Toward empirical behavior laws. I: Positive reinforcement. Psychol. Rev. 66:1959;219-233.
148. Rachlin H. Introduction to modern behaviorism. 1970;Freeman, San Francisco.
149. Rashotte M.E., Henderson D. Coping with rising food costs in a closed economy: feeding behavior and nocturnal hypothermia in pigeons. J. Exp. Anal. Behav. 50:1988;441-456.
150. Roberts D.C.S., Corcoran M.E., Fibiger H.C. On the role of ascending catecholaminergic systems in intravenous self-administration of cocaine. Pharmacol. Biochem. Behav. 6:1977;615-620.
151. Rolls E.T., Rolls B.J., Kelly P.H., Shaw S.G., Wood R.J., Dale R. The relative attenuation of selstimulation, eating and drinking produced by dopamine receptor blockade. Psychopharmacology. 38:1974;219-230.
152. Rusk I.N., Cooper S.J. Parametric studies of selective D1 and D2 antagonists: effects on appetitive and feeding behavior. Behav. Pharmacol. 5:1994;615-622.
153. Sabol K.E., Neill D.B., Wages S.A., Church W.H., Justice J.B. Dopamine depletion in a striatal subregion disrupts performance of a skilled motor task in the rat. Brain Res. 335:1985;33-43.
154. Salamone J.D. Behavioral pharmacology of dopamine systems: a new synthesis. Willner P., Scheel-Kruger J., The mesolimbic dopamine system: from motivation to action. 1991;598-613 Cambridge University Press, Cambridge, UK.
155. Salamone J.D. Complex motor and sensorimotor functions of accumbens and striatal dopamine: involvement in instrumental behavior processes. Psychopharmacology. 107:1992;160-174.
156. Salamone J.D. Different effects of haloperidol and extinction on instrumental behaviors. Psychopharmacology. 88:1986;18-23.
157. Salamone J.D. Involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 61:1994;117-133.
158. Salamone J.D. The actions of neuroleptic drugs on appetitive instrumental behaviors. Iversen L.L., Iversen S.D., Snyder S.H., Handbook of psychopharmacology. 1987;575-608 Plenum Press, New York.
159. Salamone J.D. Dopaminergic involvement in activational aspects of motivation: effects of haloperidol on schedule-induced activity, feeding and foraging in rats. Psychobiology. 16:1988;96-206.
160. Salamone J.D., Aberman J.E., Sokolowski J.D., Cousins M.S. Nucleus accumbens dopamine and rate of responding: neurochemical and behavioral studies. Psychobiology. 27:1999;236-247.
161. Salamone J.D., Arizzi M.N., Sandoval M.D., Cervone K.M., Aberman J.E. Dopamine antagonists alter response allocation but do not suppress appetite for food: contrasts between the effects of SKF 83566, raclopride and fenfluramine on a concurrent lever pressing/chow consumption task. Psychopharmacology. 160:2002;371-380.
162. Salamone JD, Cousins MS, Bucher S. Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure, Behav Brain Res, 1994;221-29.
163. Salamone J.D., Cousins M.S., McCullough L.D., Carriero D.L., Berkowitz R.J. Nucleus accumbens dopamine release increases during instrumental lever pressing for food but not food consumption. Pharmacol. Biochem. Behav. 49:1994;25-31.
164. Salamone J.D., Cousins M.S., Maio C., Champion M., Turski T., Kovach J. Different behavioral effects of haloperidol, clozapine and thioridazine in a concurrent lever pressing and feeding procedure. Psychopharmacology. 125:1996;105-112.
165. Salamone J.D., Cousins M.S., Snyder B.J. Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci. Biobehav. Rev. 21:1997;341-359.
166. Salamone J.D., Kurth P., McCullough L.D., Sokolowski J.D. The effects of nucleus accumbens dopamine depletions on continuously reinforced operant responding: contrasts with the effects of extinction. Pharmacol. Biochem. Behav. 50:1995;437-443.
167. Salamone J.D., Kurth P.A., McCullough L.D., Sokolowski J.D., Cousins M.S. The role of brain dopamine in response initiation: effects of haloperidol and regionally-specific dopamine depletions on the local rate of instrumental responding. Brain Res. 628:1993;218-226.
168. Salamone J.D., Mahan K., Rogers S. Ventrolateral striatal dopamine depletions impair feeding and food handling in rats. Pharmacol. Biochem. Behav. 44:1993;605-610.
169. Salamone J.D., Steinpreis R.E., McCullough L.D., Smith P., Grebel D., Mahan K. Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food-choice procedure. Psychopharmacology. 104:1991;515-521.
170. Salamone J.D., Wisniecki A., Carlson B.B., Correa M. Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience. 105:2001;863-870.
171. Salamone J.D., Zigmond M.J., Stricker E.M. Characterization of the impaired feeding behavior in rats given haloperidol or dopamine-depleting brain lesions. Neuroscience. 39:1990;17-24.
172. Schlosberg H. Three dimensions in emotion. Psychol. Rev. 61:1954;81-88.
173. Schneider L.H., Davis J.D., Watson C.A., Smith G.P. Similar effects of raclopride and reduced sucrose concentration on the microstructure of sucrose sham feeding. Eur. J. Pharmacol. 186:1990;61-70.
174. Schneider L.H., Sikorsky C.A., Rauhofer E.A., Davis J.D., Smith G.P. Raclopride microinjected into nucleus accumbens inhibits sucrose sham feeding. Appetite. 19:1992;215.
175. Schwab R.S. Akinesia paradoxica. Electroencephalogr. Clin. Neurophysiol. 31:1972;87-92.
176. Schwab R.S., Zieper I. Effects of mood, motivation, stress and altertness on the performance in Parkinson's disease. Psychiatry Neurobiol. 150:1965;345-357.
177. Schwarting R., Carey R.J. Deficits in inhibitory avoidance after neurotoxic lesions of the ventral striatum are neurochemically and behaviorally selective. Behav. Brain Res. 18:1985;279-283.
178. Setlow B., McGaugh J.L. Differential effects of immediate posttraining sulpiride microinfusions into the nucleus accumbens shell and core on Morris water maze retention. Psychobiology. 27:1999;248-255.
179. Setlow B., McGaugh J.L. Sulpiride infused into the nucleus accumbens posttraining impairs memory of spatial water maze training. Behav. Neurosci. 112:1998;603-610.
180. Sheffield F.D., Roby T.R. Reward value of a non-nutritive sweet taste. J. Comp. Physiol. Psychol. 43:1950;471-481.
181. Skinner B.F. Science and human behavior. 1953;Macmillan, New York.
182. Skinner B.F. The behavior of organisms: an experimental analysis. 1938;Appleton-Century, New York.
183. Skitek E.B., Fowler S.C., Tessel R.E. Effects of unilateral striatal dopamine depletion on tongue force and rhythm during licking in rats. Behav. Neurosci. 113:1999;567-573.
184. Smith G.P. Dopamine and food reward. Prog. Psychobiol. Physiol. Psychol. 16:1995;83-144.
185. Sokolowski J.D., Salamone J.D. The role of nucleus accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacol. Biochem. Behav. 59:1998;557-566.
186. Spence K.W. Behavior theory and conditioning. 1956;Yale University Press, New Haven.
187. Spivak K.J., Amit Z. Effects of pimozide on appetitive behavior and locomotor activity: dissimilarity of effects when compared to extinction. Physiol. Behav. 36:1986;457-463.
188. Staddon J.E.R. Adaptive behavior and learning. 1983;Cambridge University Press, Cambridge, UK.
189. Staddon J.E.R. Operant behavior as adaptation to constraint. J. Exp. Psychol. Gen. 108:1979;48-67.
190. Staddon J.E.R., Ettenger R.H. Learning: an Introduction to the principles of adaptive behavior. 1989;Harcourt Brace and Jovanovitch, New York.
191. Stefurak T.L., van der Kooy D. Tegmental pedunculopontine lesions in rats decrease saccharin's rewarding effects but no its memory-improving effects. Behav. Neurosci. 108:1994;972-980.
192. Swerdlow N.R., Braff D.L., Taaid N., Geyer M.A. Assessing the validity of am animal model of deficient sensorimotor gating in scnizophrenic patients. Arch. Gen. Psychiatry. 51:1994;139-154.
193. Szczpka M.S., Kwok K., Brot M.D., Marck B.T., Matsumoto A.M., Donahue B.A., Palmiter R.D. Dopamine production in the caudate putamen restores feeding in dopamine-deficient mice. Neuron. 30:2001;819-828.
194. Szechtman H., Talangbayan H., Ganaran G., Dai H., Eilam D. Dynamics of behavioral sensitization induced by the dopamine agonist quinpirole and a proposed central energy control mechanism. Psychopharmacology. 115:1994;95-104.
195. Tapp J.T. Activity, reactivity, and the behavior-directing properties of stimuli. Tapp J.T., Reinforcement and behavior. 1969;387-416 Academic Press, New York.
196. Teuber H.L., Proctor F. Some effects of basal ganglia lesions in subhuman primates and man. Neuropsychologia. 2:1964;85-93.
197. Thorndike E.L. Animal intelligence. 1911;Macmillan, New York.
198. Timberlake W., Allison J. Response deprivation: an empirical approach to instrumental performance. Psychol. Rev. 81:1974;146-164.
199. Timberlake W. Behavior systems and reinforcement: an integrative approach. J. Exp. Anal. Behav. 60:1993;105-128.
200. Tolman E.C. Purposive behavior in animals and men. 1967;Appleton, Century Crofts, New York.
201. Tombaugh T.N., Anisman H., Tombaugh J. Extinction and dopamine receptor blockade after intermittent reinforcement training: failure to observe functional equivalence. Psychopharmacology. 70:1980;19-28.
202. Tombaugh T.N., Szostak C., Mills P. Failure of pimozide to disrupt acquisition of light-dark and spatial discrimination problems. Psychopharmacology. 79:1983;161-168.
203. Tombaugh T.N., Szostak C., Voorneveld P., Tombaugh J.W. Failure to obtain functional equivalence between dopamine receptor blockade and extinction: evidence supporting an sensory-motor conditioning hypothesis. Pharmacol. Biochem. Behav. 16:1982;67-72.
204. Treit D., Berridge K.C. A comparison of benzodiazepine, serotonin, and dopamine agents in taste-reactivity paradigm. Pharmacol. Biochem. Behav. 37:1990;451-456.
205. Trevitt J.T., Carlson B.B., Nowend K.L., Cervone K., Salamone J.D. Substantia nigra pars reticulata is a highly potent site of action for the behavioral effects of the D1 antagonist SCH 23390. Psychopharmacology. 156:2001;32-41.
206. Trevitt J.T., Lyons M., Aberman J., Carriero D., Finn M., Salamone J.D. Effects of clozapine, thioridazine, risperidone and haloperidol on behavioral tests related to extrapyramidal motor function. Psychopharmacology. 132:1997;74-81.
207. Ungerstedt U. Aphagia and adipsia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system. Acta Physiol. Scand. 82:1971;95-122.
208. Ungerstedt U., Ljungberg T. Central dopamine neurons and sensory processing. J. Psychiatr. Res. 55:1974;149-150.
209. Wade T.R., de Wit H., Richards J.B. Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology. 150:2000;90-101.
210. Weiner I., Feldon J. Facilitation of latent inhibition by haloperidol in rats. Psychopharmacology. 91:1987;248-253.
211. Weissenborn R., Blaha C.D., Winn P., Phillips A.G. Schedule-induced polydipsia and the nucleus accumbens: electrochemical measurements of dopamine efflux and effects of excitotoxic lesions in the core. Behav. Brain Res. 75:1996;147-158.
212. White N.M. Control of sensorimotor functions by dopaminergic nigrostriatal neurons: influence on eating and drinking. Neurosci. Biobehav. Rev. 10:1986;15-36.
213. Wiesenfeld Z., Halpern B.P., Tapper D.N. Licking behavior: evidence of a hypoglossal oscillator. Science. 196:1977;1122-1124.
214. Willner P., Chawala K., Sampson D., Sophokleous S., Muscat R. Tests of functional equivalence between pimozide pretreatment, extinction and free feeding. Psychopharmacology. 95:1988;423-426.
215. Wise R.A. Catecholamine theories of reward: a critical review. Brain Res. 152:1978;215-247.
216. Wise R.A. Cognitive factors in addiction and nucleus accumbens function: some hints from rodent models. Psychobiology. 27:1986;300-310.
217. Wise R.A. Psychomotor stimulant properties of addictive drugs. Annal. New York Acad. Sci. 537:1988;228-234.
218. Wise R.A. The anhedonia hypothesis: Mark III. Behav. Brain Sci. 8:1985;178-186.
219. Wise R.A. Neuroleptics and operant behavior: the anhedonia hypothesis. Behav. Brain Sci. 5:1982;39-87.
220. Wise R.A., Colle L.M. Pimozide attenuates free feeding: best scores analysis reveals a motivational deficit. Psychopharmacology. 84:1984;446-451.
221. Wise R.A., Raptis L. Effects of pre-feeding on food-approach latency and food consumption speed in food deprived rats. Physiol. Behav. 35:1985;961-963.
222. Wise R.A., Rompre P.P. Brain dopamine and reward. Annu. Rev. Psychol. 40:1989;191-225.
223. Wise R.A., Spindler J., De Witt H., Gerber G.J. Neuroleptic-induced 'anhedonia' in rats: pimozide blocks reward quality of food. Science. 201:1978;262-264.
224. Wise R.A., Spindler J., Legult L. Major attenuation of food reward with performance-sparing doses of pimozide in the rat. Can. J. Psychol. 32:1978;77-85.
225. Wolterink G., Phillips G., Cador M., Donselaar-Wolterink I., Robbins T.W., Everitt B.J. Relative roles of ventral striatal D1 and D2 dopamine receptors in responding with conditioned reinforcement. Psychopharmacology. 110:1993;355-364.
226. Xenakis S., Sclafani A. The dopaminergic mediation of a sweet reward in normal and VMH hyperphagic rats. Pharmacol. Biochem. Behav. 16:1982;293-302.
227. Young A.M.J., Ahier R.G., Upton R.L., Joseph M.H., Gray J.A. Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli. Neuroscience. 83:1998;1175-1183.
228. Zahm D.S., Brog J.S. On the significance of subterritories in the 'accumbens' part of the rat ventral striatum. Neuroscience. 50:1992;751-767.