Putting desire on a budget: Dopamine and energy expenditure, reconciling reward and resources

Frontiers in Integrative Neuroscience

Volumn , Issue JULY 2012, 2012, Pages

  Beeler, Jeff A ^a   Frazier, Cristianne R M ^a   Zhuang, Xiaoxi ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Basal ganglia; Cost sensitivity; Dopamine; Effort; Energy management; Eward; Explore exploit; Incentive salience

Indexed keywords

DOPAMINE; DOPAMINE 1 RECEPTOR BLOCKING AGENT; DOPAMINE 1 RECEPTOR STIMULATING AGENT; INSULIN; LEPTIN; QUINPIROLE;

ANIMAL BEHAVIOR; ARTICLE; BRAIN FUNCTION; DISSOCIATION; DOPAMINERGIC SYSTEM; ELECTROENCEPHALOGRAM; ENERGY BALANCE; ENERGY CONSERVATION; ENERGY EXPENDITURE; FOOD INTAKE; FOOD PREFERENCE; HOMEOSTASIS; HUMAN; LEARNING; NONHUMAN; OBESITY; PREVALENCE; REWARD; SEDENTARY LIFESTYLE;

EID: 84865089297     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2012.00049     Document Type: Article

References (283)

1. Aberman, J. E., and Salamone, J. D. (1999). Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92, 545-552.
2. Aberman, J. E., Ward, S. J., and Salamone, J. D. (1998). Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive-ratio performance. Pharmacol. Biochem. Behav. 61, 341-348.
3. Ahlenius, S., Hillegaart, V., Thorell, G., Magnusson, O., and Fowler, C. J. (1987). Suppression of exploratory locomotor activity and increase in dopamine turnover following the local application of cis-flupenthixol into limbic projection areas of the rat striatum. Brain Res. 402, 131-138.
4. Albin, R. L., Young, A. B., and Penney, J. B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci. 12, 366-375.
5. Albin, R. L., Young, A. B., and Penney, J. B. (1995). The functional anatomy of disorders of the basal ganglia. Trends Neurosci. 18, 63-64.
6. Alevizos, A., Lentzas, J., Kokkoris, S., Mariolis, A., and Korantzopoulos, P. (2005). Physical activity and stroke risk. Int. J. Clin. Pract. 59, 922-930.
7. Alexander, G. E. (1994). Basal gangliathalamocortical circuits: their role in control of movements. J. Clin. Neurophysiol. 11, 420-431.
8. Alexander, G. E., and Crutcher, M. D. (1990). Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci. 13, 266-271.
9. Alexander, G. E., Crutcher, M. D., and DeLong, M. R. (1990). Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog. Brain Res. 85, 119-146.
10. Allison, D. B., and Casey, D. E. (2001). Antipsychotic-induced weight gain: a review of the literature. J. Clin. Psychiatry 62(Suppl. 7), 22-31.
11. Anderzhanova, E., Covasa, M., and Hajnal, A. (2007). Altered basal and stimulated accumbens dopamine release in obese OLETF rats as a function of age and diabetic status. Am. J. Physiol. Regul. Integr. Comp. Physiol. 293, R603-R611.
12. Arase, K., Fisler, J. S., Shargill, N. S., York, D. A., and Bray, G. A. (1988). Intracerebroventricular infusions of 3-OHB and insulin in a rat model of dietary obesity. Am. J. Physiol. 255, R974-R981.
13. Avena, N. M., and Bocarsly, M. E. (2011). Dysregulation of brain reward systems in eating disorders: neurochemical information from animal models of binge eating, bulimia nervosa, and anorexia nervosa. Neuropharmacology 63, 87-96.
14. Avena, N. M., Rada, P., and Hoebel, B. G. (2008). Evidence for sugar addiction: behavioral and neurochemical effects of intermittent, excessive sugar intake. Neurosci. Biobehav. Rev. 32, 20-39.
15. Avena, N. M., Rada, P., and Hoebel, B. G. (2009). Sugar and fat bingeing have notable differences in addictive-like behavior. J. Nutr. 139, 623-628.
16. Baldo, B., Sadeghian, K., and Basso, A. (2002). Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on ingestive behavior and associated motor activity. Behav. Brain Res. 137, 165-177.
17. Balleine, B. W. (2005). Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol. Behav. 86, 717-730.
18. Balleine, B. W., Delgado, M. R., and Hikosaka, O. (2007). The role of the dorsal striatum in reward and decision-making. J. Neurosci. 27, 8161-8165.
19. Balleine, B. W., and O'Doherty, J. P. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35, 48-69.
20. Bardgett, M. E., Depenbrock, M., Downs, N., Points, M., and Green, L. (2009). Dopamine modulates effort-based decision making in rats. Behav. Neurosci. 123, 242-251.
21. Baxter, M., and Murray, E. (2002). The amygdala and reward. Nat. Rev. Neurosci. 3, 563-573.
22. Beeler, J. A. (2011). Preservation of function in Parkinson's disease: what's learning got to do with it? Brain Res. 1423, 96-113.
23. Beeler, J. A., Cao, Z. F. H., Kheirbek, M. A., and Zhuang, X. (2009). Loss of cocaine locomotor response in Pitx3-deficient mice lacking a nigrostriatal pathway. Neuropsychopharmacology 34, 1149-1161.
24. Beeler, J. A., Daw, N., Frazier, C. R. M., and Zhuang, X. (2010). Tonic dopamine modulates exploitation of reward learning. Front. Behav. Neurosci. 4:170. doi: 10.3389/fnbeh.2010.00170
25. Beeler, J. A., Frazier, C. R. M., and Zhuang, X. (2012a). Dopaminergic enhancement of local food-seeking is under global homeostatic control. Eur. J. Neurosci. 35, 146-159.
26. Beeler, J. A., McCutcheon, J. E., Cao, Z. F. H., Murakami, M., Alexander, E., Roitman, M. F., and Zhuang, X. (2012b). Taste uncoupled from nutrition fails to sustain the reinforcing properties of food. Eur. J. Neurosci. doi: 10.1111/j.1460-9568.2012.08167.x. [Epub ahead of print].
27. Beeler, J. A., Prendergast, B., and Zhuang, X. (2006). Low amplitude entrainment of mice and the impact of circadian phase on behavior tests. Physiol. Behav. 87, 870-880.
28. Behrens, T. E. J., Woolrich, M. W., Walton, M. E., and Rushworth, M. F. S. (2007). Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214-1221.
29. Beninger, R. J. (1983). The role of dopamine in locomotor activity and learning. Brain Res. 287, 173-196.
30. Berridge, K. C. (2004). Motivation concepts in behavioral neuroscience. Physiol. Behav. 81, 179-209.
31. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl.) 191, 391-431.
32. Berridge, K. C., Ho, C.-Y., Richard, J. M., and DiFeliceantonio, A. G. (2010). The tempted brain eats: pleasure and desire circuits in obesity and eating disorders. Brain Res. 1350, 43-64.
33. Berthoud, H.-R., Lenard, N. R., and Shin, A. C. (2011). Food reward, hyperphagia, and obesity. Am. J. Physiol. Regul. Integr. Comp. Physiol. 300, R1266-R1277.
34. Bi, S. (2005). Running wheel activity prevents hyperphagia and obesity in otsuka long-evans tokushima fatty rats: role of hypothalamic signaling. Endocrinology 146, 1676-1685.
35. Billes, S. K., and Cowley, M. A. (2008). Catecholamine reuptake inhibition causes weight loss by increasing locomotor activity and thermogenesis. Neuropsychopharmacology 33, 1287-1297.
36. Blum, K., Braverman, E. R., Holder, J. M., Lubar, J. F., Monastra, V. J., Miller, D., Lubar, J. O., Chen, T. J., and Comings, D. E. (2000). Reward deficiency syndrome: a biogenetic model for the diagnosis and treatment of impulsive, addictive, and compulsive behaviors. J. Psychoactive Drugs 32(Suppl. i-iv), 1-112.
37. Blum, K., Liu, Y., Shriner, R., and Gold, M. S. (2011). Reward circuitry dopaminergic activation regulates food and drug craving behavior. Curr. Pharm. Des. 17, 1158-1167.
38. Bolam, J. P., Hanley, J. J., Booth, P. A., and Bevan, M. D. (2000). Synaptic organisation of the basal ganglia. J. Anat. 196(Pt 4), 527-542.
39. Booth, F. W., Gordon, S. E., Carlson, C. J., and Hamilton, M. T. (2000). Waging war on modern chronic diseases: primary prevention through exercise biology. J. Appl. Physiol. 88, 774-787.
40. Booth, F. W., and Lees, S. J. (2007). Fundamental questions about genes, inactivity, and chronic diseases. Physiol. Genomics 28, 146-157.
41. Brené, S., BjØrnebekk, A., Aberg, E., Mathé, A. A., Olson, L., and Werme, M. (2007). Running is rewarding and antidepressive. Physiol. Behav. 92, 136-140.
42. Brown, H. D., McCutcheon, J. E., Cone, J. J., Ragozzino, M. E., and Roitman, M. F. (2011). Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum. Eur. J. Neurosci. 34, 1997-2006.
43. Brownlow, B. S., Petro, A., Feinglos, M. N., and Surwit, R. S. (1996). The role of motor activity in dietinduced obesity in C57BL/6J mice. Physiol. Behav. 60, 37-41.
44. Cagniard, B., Balsam, P. D., Brunner, D., and Zhuang, X. (2006a). Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology 31, 1362-1370.
45. Cagniard, B., Beeler, J. A., Britt, J. P., McGehee, D. S., Marinelli, M., and Zhuang, X. (2006b). Dopamine scales performance in the absence of new learning. Neuron 51, 541-547.
46. Cannon, C. (2004). Is dopamine required for natural reward? Physiol. Behav. 81, 741-748.
47. Cannon, C. M., and Palmiter, R. D. (2003). Reward without dopamine. J. Neurosci. 23, 10827-10831.
48. Carlsson, A. (1993). On the neuronal circuitries and neurotransmitters involved in the control of locomotor activity. J. Neural Transm. Suppl. 40, 1-12.
49. Carr, K. D. (2007). Chronic food restriction: enhancing effects on drug reward and striatal cell signaling. Physiol. Behav. 91, 459-472.
50. Carr, K. D. (2011). Food scarcity, neuroadaptations, and the pathogenic potential of dieting in an unnatural ecology: binge eating and drug abuse. Physiol. Behav. 104, 162-167.
51. Carr, K. D., Kim, G., and Cabeza de Vaca, S. (2000). Hypoinsulinemia may mediate the lowering of selfstimulation thresholds by food restriction and streptozotocininduced diabetes. Brain Res. 863, 160-168.
52. Carroll, M. E., and Meisch, R. A. (1980). The effects of feeding conditions on drug-reinforced behavior: maintenance at reduced body weight versus availability of food. Psychopharmacology (Berl.) 68, 121-124.
53. Chakravarthy, M. V., and Booth, F. W. (2004). Eating, exercise, and "thrifty" genotypes: connecting the dots toward an evolutionary understanding of modern chronic diseases. J. Appl. Physiol. 96, 3-10.
54. Chaney, M. A., and Rowland, N. E. (2008). Food demand functions in mice. Appetite 51, 669-675.
55. Chaput, J.-P., Klingenberg, L., Rosenkilde, M., Gilbert, J.-A., Tremblay, A., and Sjödin, A. (2011). Physical activity plays an important role in body weight regulation. J. Obes. 2011, 1-11.
56. Charntikov, S., Der-Ghazarian, T., Herbert, M. S., Horn, L. R., Widarma, C. B., Gutierrez, A., Varela, F. A., and McDougall, S. A. (2011). Importance of D1 and D2 receptors in the dorsal caudate-putamen for the locomotor activity and stereotyped behaviors of preweanling rats. Neuroscience 183, 121-133.
57. Cheer, J. F., Aragona, B. J., Heien, M. L. A. V., Seipel, A. T., Carelli, R. M., and Wightman, R. M. (2007). Coordinated accumbal dopamine release and neural activity drive goal-directed behavior. Neuron 54, 237-244.
58. Cohen, M. X., and Frank, M. J. (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. Brain Res. 199, 141-156.
59. Connor, T., Dickinson, A., and Everitt, B. (2001). Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci. 13, 1984-1992.
60. Correa, M., Carlson, B. B., Wisniecki, A., and Salamone, J. D. (2002). Nucleus accumbens dopamine and work requirements on interval schedules. Behav. Brain Res. 137, 179-187.
61. Corwin, R. L., and Grigson, P. S. (2009). Symposium overview-Food addiction: fact or fiction? J. Nutr. 139, 617-619.
62. Cousins, M. S., Sokolowski, J. D., and Salamone, J. D. (1993). Different effects of nucleus accumbens and ventrolateral striatal dopamine depletions on instrumental response selection in the rat. Pharmacol. Biochem. Behav. 46, 943-951.
63. Dagher, A. (2009). The neurobiology of appetite: hunger as addiction. Int. J. Obes. 33, S30-S33.
64. Damak, S., Rong, M., Yasumatsu, K., Kokrashvili, Z., Pérez, C. A., Shigemura, N., Yoshida, R., Mosinger, B. Jr., Glendinning, J. I., Ninomiya, Y., and Margolskee, R. F. (2006). Trpm5 null mice respond to bitter, sweet, and umami compounds. Chem. Senses 31, 253-264.
65. David, H. N., Ansseau, M., and Abraini, J. H. (2005). Dopamine-glutamate reciprocal modulation of release and motor responses in the rat caudate-putamen and nucleus accumbens of "intact" animals. Brain Res. Brain Res. Rev. 50, 336-360.
66. Davis, C., and Carter, J. C. (2009). Compulsive overeating as an addiction disorder. A review of theory and evidence. Appetite 53, 1-8.
67. Davis, C., Patte, K., Levitan, R., Reid, C., Tweed, S., and Curtis, C. (2007). From motivation to behaviour: a model of reward sensitivity, overeating, and food preferences in the risk profile for obesity. Appetite 48, 12-19.
68. Davis, J. F., Choi, D. L., and Benoit, S. C. (2010a). Insulin, leptin and reward. Trends Endocrinol. Metab. 21, 68-74.
69. Davis, J. F., Choi, D. L., Schurdak, J. D., Fitzgerald, M. F., Clegg, D. J., Lipton, J. W., Figlewicz, D. P., and Benoit, S. C. (2010b). Leptin regulates energy balance and motivation through action at distinct neural circuits. Biol. Psychiatry 69, 668-674.
70. Davis, J. F., Tracy, A. L., Schurdak, J. D., Tschöp, M. H., Lipton, J. W., Clegg, D. J., and Benoit, S. C. (2008). Exposure to elevated levels of dietary fat attenuates psychostimulant reward and mesolimbic dopamine turnover in the rat. Behav. Neurosci. 122, 1257-1263.
71. Daw, N. D., and Doya, K. (2006). The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 16, 199-204.
72. Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711.
73. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441, 876-879.
74. Day, J. J., and Carelli, R. M. (2007). The nucleus accumbens and Pavlovian reward learning. Neuroscientist 13, 148-159.
75. Day, J. J., Jones, J. L., and Carelli, R. M. (2011). Nucleus accumbens neurons encode predicted and ongoing reward costs in rats. Eur. J. Neurosci. 33, 308-321.
76. Day, J. J., Jones, J. L., Wightman, R. M., and Carelli, R. M. (2010). Phasic nucleus accumbens dopamine release encodes effort- and delayrelated costs. Biol. Psychiatry 68, 306-309.
77. Day, J. J., Wheeler, R. A., Roitman, M. F., and Carelli, R. M. (2006). Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm. Eur. J. Neurosci. 23, 1341-1351.
78. Dayan, P., and Balleine, B. W. (2002). Reward, motivation, and reinforcement learning. Neuron 36, 285-298.
79. Dayan, P., and Niv, Y. (2008). Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 18, 185-196.
80. de Araujo, I. E., Oliveira-Maia, A. J., Sotnikova, T. D., Gainetdinov, R. R., Caron, M. G., Nicolelis, M. A. L., and Simon, S. A. (2008). Food reward in the absence of taste receptor signaling. Neuron 57, 930-941.
81. de Araujo, I. E., Ren, X., and Ferreira, J. G. (2010). Metabolic sensing in brain dopamine systems. Results Probl. Cell Differ. 52, 69-86.
82. DeLong, M., and Wichmann, T. (2009). Update on models of basal ganglia function and dysfunction. Parkinsonism Relat. Disord. 15(Suppl. 3), S237-S240.
83. Di Chiara, G., Tanda, G., Cadoni, C., Acquas, E., Bassareo, V., and Carboni, E. (1998). Homologies and differences in the action of drugs of abuse and a conventional reinforcer (food) on dopamine transmission: an interpretative framework of the mechanism of drug dependence. Adv. Pharmacol. 42, 983-987.
84. Dishman, R. K. (2008). Gene-physical activity interactions in the etiology of obesity: behavioral considerations. Obesity (Silver Spring) 16(Suppl. 3), S60-S65.
85. El-Amamy, H., and Holland, P. C. (2007). Dissociable effects of disconnecting amygdala central nucleus from the ventral tegmental area or substantia nigra on learned orienting and incentive motivation. Eur. J. Neurosci. 25, 1557-1567.
86. Elder, S. J., and Roberts, S. B. (2007). The effects of exercise on food intake and body fatness: a summary of published studies. Nutr. Rev. 65, 1-19.
87. Elmquist, J. K., Coppari, R., Balthasar, N., Ichinose, M., and Lowell, B. B. (2005). Identifying hypothalamic pathways controlling food intake, body weight, and glucose homeostasis. J. Comp. Neurol. 493, 63-71.
88. Enriori, P. J., Evans, A. E., Sinnayah, P., Jobst, E. E., Tonelli-Lemos, L., Billes, S. K., Glavas, M. M., Grayson, B. E., Perello, M., Nillni, E. A., Grove, K. L., and Cowley, M. A. (2007). Diet-induced obesity causes severe but reversible leptin resistance in arcuate melanocortin neurons. Cell Metab. 5, 181-194.
89. Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8, 1481-1489.
90. Farooqi, I. S., Bullmore, E., Keogh, J., Gillard, J., O'Rahilly, S., and Fletcher, P. C. (2007). Leptin regulates striatal regions and human eating behavior. Science 317, 1355.
91. Figlewicz, D. P., Bennett, J. L., Aliakbari, S., Zavosh, A., and Sipols, A. J. (2008). Insulin acts at different CNS sites to decrease acute sucrose intake and sucrose self-administration in rats. Am. J. Physiol. Regul. Integr. Comp. Physiol. 295, R388-R394.
92. Figlewicz, D. P., Bennett, J., Evans, S. B., Kaiyala, K., Sipols, A. J., and Benoit, S. C. (2004). Intraventricular insulin and leptin reverse place preference conditioned with high-fat diet in rats. Behav. Neurosci. 118, 479-487.
93. Figlewicz, D. P., Bennett, J. L., Naleid, A. M., Davis, C., and Grimm, J. W. (2006). Intraventricular insulin and leptin decrease sucrose selfadministration in rats. Physiol. Behav. 89, 611-616.
94. Figlewicz, D. P., and Benoit, S. C. (2009). Insulin, leptin, and food reward: update (2008). Am. J. Physiol. Regul. Integr. Comp. Physiol. 296, R9-R19.
95. Figlewicz, D. P., Higgins, M. S., Ng-Evans, S. B., and Havel, P. J. (2001). Leptin reverses sucrose-conditioned place preference in foodrestricted rats. Physiol. Behav. 73, 229-234.
96. Figlewicz, D. P., Macdonald Naleid, A., and Sipols, A. J. (2007). Modulation of food reward by adiposity signals. Physiol. Behav. 91, 473-478.
97. Figlewicz, D. P., and Sipols, A. J. (2010). Energy regulatory signals and food reward. Pharmacol. Biochem. Behav. 97, 15-24.
98. Finlayson, G., King, N., and Blundell, J. E. (2007). Liking vs. wanting food: importance for human appetite control and weight regulation. Neurosci. Biobehav. Rev. 31, 987-1002.
99. Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., and Akil, H. (2010). A selective role for dopamine in stimulus-reward learning. Nature 469, 53-57.
100. Foley, T. E., and Fleshner, M. (2008). Neuroplasticity of dopamine circuits after exercise: implications for central fatigue. Neuromolecular Med. 10, 67-80.
101. Fontanini, A., and Katz, D. B. (2009). Behavioral modulation of gustatory cortical activity. Ann. N.Y. Acad. Sci. 1170, 403-406.
102. Ford, E. S., and Mokdad, A. H. (2008). Epidemiology of obesity in the western hemisphere. J. Clin. Endocrinol. Metab. 93, S1-S8.
103. Frank, M. J., Doll, B. B., Oas-Terpstra, J., and Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat. Neurosci. 12, 1062-1068.
104. Fulton, S., Pissios, P., Manchon, R. P., Stiles, L., Frank, L., Pothos, E. N., Maratos-Flier, E., and Flier, J. S. (2006). Leptin regulation of the mesoaccumbens dopamine pathway. Neuron 51, 811-822.
105. Fulton, S., Woodside, B., and Shizgal, P. (2000). Modulation of brain reward circuitry by leptin. Science 287, 125-128.
106. Funkat, A., Massa, C. M., Jovanovska, V., Proietto, J., and Andrikopoulos, S. (2004). Metabolic adaptations of three inbred strains of mice (C57BL/6, DBA/2, and 129T2) in response to a high-fat diet. J. Nutr. 134, 3264-3269.
107. Gaesser, G. A. (2007). Exercise for prevention and treatment of cardiovascular disease, type 2 diabetes, and metabolic syndrome. Curr. Diab. Rep. 7, 14-19.
108. Gan, J. O., Walton, M. E., and Phillips, P. E. M. (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 13, 25-27.
109. Garland, T. Jr., Schutz, H., Chappell, M. A., Keeney, B. K., Meek, T. H., Copes, L. E., Acosta, W., Drenowatz, C., Maciel, R. C., van Dijk, G., Kotz, C. M., and Eisenmann, J. C. (2011). The biological control of voluntary exercise, spontaneous physical activity and daily energy expenditure in relation to obesity: human and rodent perspectives. J. Exp. Biol. 214, 206-229.
110. Geiger, B. M., Behr, G. G., Frank, L. E., Caldera-Siu, A. D., Beinfeld, M. C., Kokkotou, E. G., and Pothos, E. N. (2008). Evidence for defective mesolimbic dopamine exocytosis in obesity-prone rats. FASEB J. 22, 2740-2746.
111. Geiger, B. M., Haburcak, M., Avena, N. M., Moyer, M. C., Hoebel, B. G., and Pothos, E. N. (2009). Deficits of mesolimbic dopamine neurotransmission in rat dietary obesity. Neuroscience 159, 1193-1199.
112. Goto, Y., Otani, S., and Grace, A. A. (2007). The Yin and Yang of dopamine release: a new perspective. Neuropharmacology 53, 583-587.
113. Greendale, G. A., Barrett-Connor, E., Edelstein, S., Ingles, S., and Haile, R. (1995). Lifetime leisure exercise and osteoporosis. The Rancho Bernardo study. Am. J. Epidemiol. 141, 951-959.
114. Greenwood, B. N., Foley, T. E., Le, T. V., Strong, P. V., Loughridge, A. B., Day, H. E. W., and Fleshner, M. (2011). Long-term voluntary wheel running is rewarding and produces plasticity in the mesolimbic reward pathway. Behav. Brain Res. 217, 354-362.
115. Greenwood, M. R., Quartermain, D., Johnson, P. R., Cruce, J. A., and Hirsch, J. (1974). Food motivated behavior in genetically obese and hypothalamic-hyperphagic rats and mice. Physiol. Behav. 13, 687-692.
116. Haase, L., Cerf-Ducastel, B., and Murphy, C. (2009). Cortical activation in response to pure taste stimuli during the physiological states of hunger and satiety. Neuroimage 44, 1008-1021.
117. Haber, S. (2003). The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 26, 317-330.
118. Haber, S. N., and Knutson, B. (2010). The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35, 4-26.
119. Hajnal, A., Smith, G. P., and Norgren, R. (2004). Oral sucrose stimulation increases accumbens dopamine in the rat. Am. J. Physiol. Regul. Integr. Comp. Physiol. 286, R31-R37.
120. Hattori, S., Li, Q., Matsui, N., and Nishino, H. (1993). Treadmill running combined with microdialysis can evaluate motor deficit and improvement following dopaminergic grafts in 6-OHDA lesioned rats. Restor. Neurol. Neurosci. 6, 65-72.
121. Hattori, S., Naoi, M., and Nishino, H. (1994). Striatal dopamine turnover during treadmill running in the rat: relation to the speed of running. Brain Res. Bull. 35, 41-49.
122. Havel, P. J. (2000). Role of adipose tissue in body-weight regulation: mechanisms regulating leptin production and energy balance. Proc. Nutr. Soc. 59, 359-371.
123. Hawley, J. A., and Holloszy, J. O. (2009). Exercise: it's the real thing! Nutr. Rev. 67, 172-178.
124. Helmrich, S. P., Ragland, D. R., Leung, R. W., and Paffenbarger, R. S. (1991). Physical activity and reduced occurrence of non-insulindependent diabetes mellitus. N. Engl. J. Med. 325, 147-152.
125. Hesse, D., Dunn, M., Heldmaier, G., Klingenspor, M., and Rozman, J. (2010). Behavioural mechanisms affecting energy regulation in mice prone or resistant to dietinduced obesity. Physiol. Behav. 99, 370-380.
126. Hill, J. O., Wyatt, H. R., Reed, G. W., and Peters, J. C. (2003). Obesity and the environment: where do we go from here? Science 299, 853-855.
127. Hodos, W. (1961). Progressive ratio as a measure of reward strength. Science 134, 943-944.
128. Holland, P. C., and Gallagher, M. (1993). Amygdala central nucleus lesions disrupt increments, but not decrements, in conditioned stimulus processing. Behav. Neurosci. 107, 246-253.
129. Holloszy, J. O. (1988). Exercise and longevity: studies on rats. J. Gerontol. 43, B149-B151.
130. Holloszy, J. O., Smith, E. K., Vining, M., and Adams, S. (1985). Effect of voluntary exercise on longevity of rats. J. Appl. Physiol. 59, 826-831.
131. Hommel, J. D., Trinko, R., Sears, R. M., Georgescu, D., Liu, Z. W., Gao, X. B., Thurmon, J. J., Marinelli, M., and DiLeone, R. J. (2006). Leptin receptor signaling in midbrain dopamine neurons regulates feeding. Neuron 51, 801-810.
132. Huang, X.-F., Yu, Y., Zavitsanou, K., Han, M., and Storlien, L. (2005). Differential expression of dopamine D2 and D4 receptor and tyrosine hydroxylase mRNA in mice prone, or resistant, to chronic high-fat dietinduced obesity. Brain Res. Mol. Brain Res. 135, 150-161.
133. Huffman, D. M., Moellering, D. R., Grizzle, W. E., Stockard, C. R., Johnson, M. S., and Nagy, T. R. (2008). Effect of exercise and calorie restriction on biomarkers of aging in mice. Am. J. Physiol. Regul. Integr. Comp. Physiol. 294, R1618-R1627.
134. Humphries, M. D., Khamassi, M., and Gurney, K. (2012). Dopaminergic control of the explorationexploitation trade-off via the basal ganglia. Front. Neurosci. 6:9. doi: 10.3389/fnins.2012.00009
135. Humphries, M. D., and Prescott, T. J. (2010). The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. Prog. Neurobiol. 90, 385-417.
136. Hursh, S. R., Raslear, T. G., Shurtleff, D., Bauman, R., and Simmons, L. (1988). A cost-benefit analysis of demand for food. J. Exp. Anal. Behav. 50, 419-440.
137. Hursh, S. R., and Silberberg, A. (2008). Economic demand and essential value. Psychol. Rev. 115, 186-198.
138. Ifland, J. R., Preuss, H. G., Marcus, M. T., Rourke, K. M., Taylor, W. C., Burau, K., Jacobs, W. S., Kadish, W., and Manso, G. (2009). Refined food addiction: a classic substance use disorder. Med. Hypotheses 72, 518-526.
139. Johnson, P. M., and Kenny, P. J. (2010). Dopamine D2 receptors in addiction-like reward dysfunction and compulsive eating in obese rats. Nat. Neurosci. 13, 635-641.
140. Kelley, A. E. (2004). Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neurosci. Biobehav. Rev. 27, 765-776.
141. Kelly, P. H. (1975). Unilateral 6hydroxydopamine lesions of nigrostriatal or mesolimbic dopamine-containing terminals and the drug-induced rotation of rats. Brain Res. 100, 163-169.
142. Kelly, S. A., Nehrenberg, D. L., Peirce, J. L., Hua, K., Steffy, B. M., Wiltshire, T., Pardo-Manuel de Villena, F., Garland, T., and Pomp, D. (2010). Genetic architecture of voluntary exercise in an advanced intercross line of mice. Physiol. Genomics 42, 190-200.
143. Kenny, P. J. (2010). Reward mechanisms in obesity: new insights and future directions. Neuron 69, 664-679.
144. Kheirbek, M. A., Beeler, J. A., Ishikawa, Y., and Zhuang, X. (2008). A cAMP pathway underlying reward prediction in associative learning. J. Neurosci. 28, 11401-11408.
145. Kheirbek, M. A., Britt, J. P., Beeler, J. A., Ishikawa, Y., McGehee, D. S., and Zhuang, X. (2009). Adenylyl cyclase type 5 contributes to corticostriatal plasticity and striatumdependent learning. J. Neurosci. 29, 12115-12124.
146. Kitanaka, N., Kitanaka, J., Hall, F. S., Uhl, G. R., Watabe, K., Kubo, H., Takahashi, H., Tatsuta, T., Morita, Y., and Takemura, M. (2012). A single administration of methamphetamine to mice early in the light period decreases running wheel activity observed during the dark period. Brain Res. 1429, 155-163.
147. Knab, A. M., and Lightfoot, J. T. (2010). Does the difference between physically active and couch potato lie in the dopamine system? Int. J. Biol. Sci. 6, 133-150.
148. Koek, W., France, C. P., and Javors, M. A. (2012). Morphine-induced motor stimulation, motor incoordination, and hypothermia in adolescent and adult mice. Psychopharmacology (Berl.) 219, 1027-1037.
149. Koob, G. F., and Volkow, N. D. (2010). Neurocircuitry of addiction. Neuropsychopharmacology 35, 217-238.
150. Krawczewski Carhuatanta, K. A., Demuro, G., Tschöp, M. H., Pfluger, P. T., Benoit, S. C., and Obici, S. (2011). Voluntary exercise improves high-fat diet-induced leptin resistance independent of adiposity. Endocrinology 152, 2655-2664.
151. Krügel, U., Schraft, T., Kittner, H., Kiess, W., and Illes, P. (2003). Basal and feeding-evoked dopamine release in the rat nucleus accumbens is depressed by leptin. Eur. J. Pharmacol. 482, 185-187.
152. Kurth-Nelson, Z., and Redish, A. D. (2009). Temporal-difference reinforcement learning with distributed representations. PLoS ONE 4:e7362. doi: 10.1371/journal.pone.0007362
153. LaMonte, M. J., Blair, S. N., and Church, T. S. (2005). Physical activity and diabetes prevention. J. Appl. Physiol. 99, 1205-1213.
154. Leamy, L. J., Pomp, D., and Lightfoot, J. T. (2008). An epistatic genetic basis for physical activity traits in mice. J. Hered. 99, 639-646.
155. Leddy, J. J., Epstein, L. H., Jaroni, J. L., Roemmich, J. N., Paluch, R. A., Goldfield, G. S., and Lerman, C. (2004). Influence of methylphenidate on eating in obese men. Obes. Res. 12, 224-232.
156. Lee, H., Groshek, F., and Petrovich, G. (2005). Role of amygdalo-nigral circuitry in conditioning of a visual stimulus paired with food. J. Neurosci. 25, 3881-3888.
157. Lehéricy, S., Benali, H., Van de Moortele, P.-F., Pélégrini-Issac, M., Waechter, T., Ugurbil, K., and Doyon, J. (2005). Distinct basal ganglia territories are engaged in early and advanced motor sequence learning. Proc. Natl. Acad. Sci. U.S.A. 102, 12566-12571.
158. Leinninger, G. M., Jo, Y.-H., Leshan, R. L., Louis, G. W., Yang, H., Barrera, J. G., Wilson, H., Opland, D. M., Faouzi, M. A., Gong, Y., Jones, J. C., Rhodes, C. J., Chua, S. Jr., Diano, S., Horvath, T. L., Seeley, R. J., Becker, J. B., Münzberg, H., and Myers, M. G. Jr. (2009). Leptin acts via leptin receptor-expressing lateral hypothalamic neurons to modulate the mesolimbic dopamine system and suppress feeding. Cell Metab. 10, 89-98.
159. Leinninger, G. M., Opland, D. M., Jo, Y.-H., Faouzi, M., Christensen, L., Cappellucci, L. A., Rhodes, C. J., Gnegy, M. E., Becker, J. B., Pothos, E. N., Seasholtz, A. F., Thompson, R. C., and Myers, M. G. Jr. (2011). Leptin action via neurotensin neurons controls orexin, the mesolimbic dopamine system and energy balance. Cell Metab. 14, 313-323.
160. Leng, A., Mura, A., Hengerer, B., Feldon, J., and Ferger, B. (2004). Effects of blocking the dopamine biosynthesis and of neurotoxic dopamine depletion with 1-methyl-4-phenyl-1,2,3,6- tetrahydropyridine (MPTP) on voluntary wheel running in mice. Behav Brain Res. 154, 375-383.
161. Leshan, R. L., Opland, D. M., Louis, G. W., Leinninger, G. M., Patterson, C. M., Rhodes, C. J., Münzberg, H., and Myers, M. G. (2010). Ventral tegmental area leptin receptor neurons specifically project to and regulate cocaine- and amphetamine-regulated transcript neurons of the extended central amygdala. J. Neurosci. 30, 5713-5723.
162. Levin, B. E. (2010). Developmental gene x environment interactions affecting systems regulating energy homeostasis and obesity. Front. Neuroendocrinol. 31, 270-283.
163. Levin, B. E., and Dunn-Meynell, A. A. (2004). Chronic exercise lowers the defended body weight gain and adiposity in diet-induced obese rats. Am. J. Physiol. Regul. Integr. Comp. Physiol. 286, R771-R778.
164. Leyton, M., Boileau, I., Benkelfat, C., Diksic, M., Baker, G., and Dagher, A. (2002). Amphetamineinduced increases in extracellular dopamine, drug wanting, and novelty seeking: a PET/[11C]raclopride study in healthy men. Neuropsychopharmacology 27, 1027-1035.
165. Li, Y., South, T., Han, M., Chen, J., Wang, R., and Huang, X.-F. (2009). High-fat diet decreases tyrosine hydroxylase mRNA expression irrespective of obesity susceptibility in mice. Brain Res. 1268, 181-189.
166. Lin, L., Martin, R., Schaffhauser, A. O., and York, D. A. (2001). Acute changes in the response to peripheral leptin with alteration in the diet composition. Am. J. Physiol. Regul. Integr. Comp. Physiol. 280, R504-R509.
167. Liste, I., Guerra, M. J., Caruncho, H. J., and Labandeira-Garcia, J. L. (1997). Treadmill running induces striatal Fos expression via NMDA glutamate and dopamine receptors. Exp. Brain Res. 115, 458-468.
168. Lomanowska, A., Gormley, S., and Szechtman, H. (2004). Presynaptic stimulation and development of locomotor sensitization to the dopamine agonist quinpirole. Pharmacol. Biochem. Behav. 77, 617-622.
169. Lovinger, D. M. (2010). Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum. Neuropharmacology 58, 951-961.
170. Lowe, M. R., and Levine, A. S. (2005). Eating motives and the controversy over dieting: eating less than needed versus less than wanted. Obes. Res. 13, 797-806.
171. Ludwig, T., Chua, S., Lowell, B., and Elmquist, J. (2005). The hypothalamic arcuate nucleus: a key site for mediating leptin's effects on glucose homeostasis and locomotor activity. Cell Metab. 1, 63-72.
172. Lutter, M., and Nestler, E. J. (2009). Homeostatic and hedonic signals interact in the regulation of food intake. J. Nutr. 139, 629-632.
173. Lüscher, C., and Malenka, R. C. (2011). Drug-evoked synaptic plasticity in addiction: from molecular changes to circuit remodeling. Neuron 69, 650-663.
174. MacRae, P. G., Spirduso, W. W., Walters, T. J., Farrar, R. P., and Wilcox, R. E. (1987). Endurance training effects on striatal D2 dopamine receptor binding and striatal dopamine metabolites in presenescent older rats. Psychopharmacology (Berl.) 92, 236-240.
175. Madden, G. J., Smethells, J. R., Ewan, E. E., and Hursh, S. R. (2007a). Tests of behavioral-economic assessments of relative reinforcer efficacy II: economic complements. J. Exp. Anal. Behav. 88, 355-367.
176. Madden, G. J., Smethells, J. R., Ewan, E. E., and Hursh, S. R. (2007b). Tests of behavioral-economic assessments of relative reinforcer efficacy: economic substitutes. J. Exp. Anal. Behav. 87, 219-240.
177. Mark, G. P., Blander, D. S., and Hoebel, B. G. (1991). A conditioned stimulus decreases extracellular dopamine in the nucleus accumbens after the development of a learned taste aversion. Brain Res. 551, 308-310.
178. Mathes, W. F., Nehrenberg, D. L., Gordon, R., Hua, K., Garland, T., and Pomp, D. (2010). Dopaminergic dysregulation in mice selectively bred for excessive exercise or obesity. Behav. Brain Res. 210, 155-163.
179. McClure, S. M., Daw, N. D., and Montague, P. R. (2003). A computational substrate for incentive salience. Trends Neurosci. 26, 423-428.
180. McCutcheon, J. E., Beeler, J. A., and Roitman, M. F. (2012). Sucrose-predictive cues evoke greater phasic dopamine release than saccharin-predictive cues. Synapse 66, 346-351.
181. Meek, T. H., Eisenmann, J. C., and Garland, T. (2010). Western diet increases wheel running in mice selectively bred for high voluntary wheel running. Int. J. Obes. (Lond.) 34, 960-969.
182. Meeusen, R., Smolders, I., Sarre, S., De Meirleir, K., Keizer, H., Serneels, M., Ebinger, G., and Michotte, Y. (1997). Endurance training effects on neurotransmitter release in rat striatum: an in vivo microdialysis study. Acta Physiol. Scand. 159, 335-341.
183. Mercken, E. M., Carboneau, B. A., Krzysik-Walker, S. M., and de Cabo, R. (2012). Of mice and men: the benefits of caloric restriction, exercise, and mimetics. Ageing Res. Rev. 11, 390-398.
184. Middleton, F. A., and Strick, P. L. (2000). Basal ganglia output and cognition: evidence from anatomical, behavioral, and clinical studies. Brain Cogn. 42, 183-200.
185. Mink, J. W. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 50, 381-425.
186. Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97.
187. Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947.
188. Moran, T. H., and Bi, S. (2006a). Hyperphagia and obesity in OLETF rats lacking CCK-1 receptors. Philos. Trans. R. Soc. Lond. B Biol. Sci. 361, 1211-1218.
189. Moran, T. H., and Bi, S. (2006b). Hyperphagia and obesity of OLETF rats lacking CCK1 receptors: developmental aspects. Dev. Psychobiol. 48, 360-367.
190. Morton, G. J., Blevins, J. E., Kim, F., Matsen, M., and Figlewicz, D. P. (2009). The action of leptin in the ventral tegmental area to decrease food intake is dependent on Jak-2 signaling. Am. J. Physiol. Endocrinol. Metab. 297, E202-E210.
191. Morton, G. J., Cummings, D. E., Baskin, D. G., Barsh, G. S., and Schwartz, M. W. (2006). Central nervous system control of food intake and body weight. Nature 443, 289-295.
192. Myers, M. G. (2004). Leptin receptor signaling and the regulation of mammalian physiology. Recent Prog. Horm. Res. 59, 287-304.
193. Nicola, S. M. (2007). The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology (Berl.) 191, 521-550.
194. Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 191, 507-520.
195. Norgren, R., Hajnal, A., and Mungarndee, S. S. (2006). Gustatory reward and the nucleus accumbens. Physiol. Behav. 89, 531-535.
196. Novak, C. M., Escande, C., Burghardt, P. R., Zhang, M., Barbosa, M. T., Chini, E. N., Britton, S. L., Koch, L. G., Akil, H., and Levine, J. A. (2010). Spontaneous activity, economy of activity, and resistance to diet-induced obesity in rats bred for high intrinsic aerobic capacity. Horm. Behav. 58, 355-367.
197. Opland, D. M., Leinninger, G. M., and Myers, M. G. J. (2010). Modulation of the mesolimbic dopamine system by leptin. Brain Res. 1350, 65-70.
198. Ostlund, S. B., Wassum, K. M., Murphy, N. P., Balleine, B. W., and Maidment, N. T. (2010). Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J. Neurosci. 31, 200-207.
199. Paffenbarger, R. S., Hyde, R. T., Wing, A. L., and Hsieh, C. C. (1986). Physical activity, all-cause mortality, and longevity of college alumni. N. Engl. J. Med. 314, 605-613.
200. Palmiter, R. D. (2007). Is dopamine a physiologically relevant mediator of feeding behavior? Trends Neurosci. 30, 375-381.
201. Parkinson, J. A., Robbins, T. W., and Everitt, B. J. (2000). Dissociable roles of the central and basolateral amygdala in appetitive emotional learning. Eur. J. Neurosci. 12, 405-413.
202. Paton, J. J., Belova, M. A., Morrison, S. E., and Salzman, C. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865-870.
203. Patterson, C. M., Bouret, S. G., Dunn-Meynell, A. A., and Levin, B. E. (2009). Three weeks of postweaning exercise in DIO rats produces prolonged increases in central leptin sensitivity and signaling. Am. J. Physiol. Regul. Integr. Comp. Physiol. 296, R537-R548.
204. Patterson, C. M., Dunn-Meynell, A. A., and Levin, B. E. (2008). Three weeks of early-onset exercise prolongs obesity resistance in DIO rats after exercise cessation. Am. J. Physiol. Regul. Integr. Comp. Physiol. 294, R290-R301.
205. Peciña, S., Cagniard, B., Berridge, K. C., Aldridge, J. W., and Zhuang, X. (2003). Hyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards. J. Neurosci. 23, 9395-9402.
206. Pelchat, M. L. (2009). Food addiction in humans. J. Nutr. 139, 620-622.
207. Pelleymounter, M., Cullen, M., Baker, M., Hecht, R., Winters, D., Boone, T., and Collins, F. (1995). Effects of the obese gene product on body weight regulation in ob/ob mice. Science 269, 540-543.
208. Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., and Carelli, R. M. (2003). Subsecond dopamine release promotes cocaine seeking. Nature 422, 614-618.
209. Phillips, P. E. M., Walton, M. E., and Jhou, T. C. (2007). Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl.) 191, 483-495.
210. Powell, K. E., and Blair, S. N. (1994). The public health burdens of sedentary living habits: theoretical but realistic estimates. Med. Sci. Sports Exerc. 26, 851-856.
211. Quinkert, A. W., Vimal, V., Weil, Z. M., Reeke, G. N., Schiff, N. D., Banavar, J. R., and Pfaff, D. W. (2011). Quantitative descriptions of generalized arousal, an elementary function of the vertebrate brain. Proc. Natl. Acad. Sci. U.S.A. 108(Suppl. 3), 15617-15623.
212. Rasmussen, E. B., Reilly, W., and Hillman, C. (2010). Demand for sucrose in the genetically obese Zucker (fa/fa) rat. Behav. Processes 85, 191-197.
213. Redgrave, P., Gurney, K., and Reynolds, J. (2008). What is reinforced by phasic dopamine signals? Brain Res. Rev. 58, 322-339.
214. Redish, A. D., Jensen, S., Johnson, A., and Kurth-Nelson, Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol. Rev. 114, 784-805.
215. Reynolds, J. N., Hyland, B. I., and Wickens, J. R. (2001). A cellular mechanism of reward-related learning. Nature 413, 67-70.
216. Reynolds, J. N. J., and Wickens, J. R. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw. 15, 507-521.
217. Ribeiro, A. C., Ceccarini, G., Dupré, C., Friedman, J. M., Pfaff, D. W., and Mark, A. L. (2011). Contrasting effects of leptin on food anticipatory and total locomotor activity. PLoS ONE 6:e23364. doi: 10.1371/journal.pone.0023364
218. Robbins, T. W., and Roberts, A. C. (2007). Differential regulation of fronto-executive function by the monoamines and acetylcholine. Cereb. Cortex 17(Suppl. 1), i151-i160.
219. Roberts, M. D., Gilpin, L., Parker, K. E., Childs, T. E., Will, M. J., and Booth, F. W. (2011). Dopamine D1 receptor modulation in nucleus accumbens lowers voluntary wheel running in rats bred to run high distances. Physiol. Behav. 105, 661-668.
220. Robinson, T. E., and Berridge, K. C. (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res. Brain Res. Rev. 18, 247-291.
221. Robinson, T. E., and Berridge, K. C. (2001). Incentive-sensitization and addiction. Addiction 96, 103-114.
222. Roesch, M. R., Calu, D. J., and Schoenbaum, G. (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10, 1615-1624.
223. Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., and Carelli, R. M. (2004). Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24, 1265-1271.
224. Roseberry, A. G., Painter, T., Mark, G. P., and Williams, J. T. (2007). Decreased vesicular somatodendritic dopamine stores in leptin-deficient mice. J. Neurosci. 27, 7021-7027.
225. Rosenbaum, M., Sy, M., Pavlovich, K., Leibel, R. L., and Hirsch, J. (2008). Leptin reverses weight loss-induced changes in regional neural activity responses to visual food stimuli. J. Clin. Invest. 118, 2583-2591.
226. Sabol, K. E., Richards, J. B., and Freed, C. R. (1990). In vivo dialysis measurements of dopamine and DOPAC in rats trained to turn on a circular treadmill. Pharmacol. Biochem. Behav. 36, 21-28.
227. Salamone, J. (1994). Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit procedure. Pharmacol. Biochem. Behav. 49, 85-91.
228. Salamone, J. D. (2006). Will the last person who uses the term "reward" please turn out the lights? Comments on processes related to reinforcement, learning, motivation and effort. Addict. Biol. 11, 43-44.
229. Salamone, J. D. (2007). Functions of mesolimbic dopamine: changing concepts and shifting paradigms. Psychopharmacology (Berl.) 191, 389.
230. Salamone, J. D. (2009). Dopamine, effort, and decision making: theoretical comment on Bardgett et al. (2009). Behav. Neurosci. 123, 463-467.
231. Salamone, J. D. (2011). A role for accumbens neurons in exertion of effort and evaluating effortrelated costs of instrumental actions (Commentary on Day et al.). Eur. J. Neurosci. 33, 306-307.
232. Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effortrelated functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl.) 191, 461-482.
233. Salamone, J. D., Correa, M., Farrar, A. M., Nunes, E. J., and Pardo, M. (2009a). Dopamine, behavioral economics, and effort. Front. Behav. Neurosci. 3:13. doi: 10.3389/neuro.08.013.2009
234. Salamone, J. D., Farrar, A. M., Font, L., Patel, V., Schlar, D. E., Nunes, E. J., Collins, L. E., and Sager, T. N. (2009b). Differential actions of adenosine A1 and A2A antagonists on the effort-related effects of dopamine D2 antagonism. Behav. Brain Res. 201, 216-222.
235. Salamone, J. D., Correa, M., Mingote, S. M., and Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34-41.
236. Salamone, J. D., Cousins, M. S., McCullough, L. D., Carriero, D. L., and Berkowitz, R. J. (1994). Nucleus accumbens dopamine release increases during instrumental lever pressing for food but not free food consumption. Pharmacol. Biochem. Behav. 49, 25-31.
237. Salamone, J. D., Cousins, M. S., and Snyder, B. J. (1997). Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci. Biobehav. Rev. 21, 341-359.
238. Salamone, J. D., Steinpreis, R. E., McCullough, L. D., Smith, P., Grebel, D., and Mahan, K. (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology (Berl.) 104, 515-521.
239. Salamone, J., Wisniecki, A., and Carlson, B. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105, 863-870.
240. Samorajski, T., Delaney, C., Durham, L., Ordy, J. M., Johnson, J. A., and Dunlap, W. P. (1985). Effect of exercise on longevity, body weight, locomotor performance, and passiveavoidance memory of C57BL/6J mice. Neurobiol. Aging 6, 17-24.
241. Saper, C. B., Chou, T. C., and Elmquist, J. K. (2002). The need to feed: homeostatic and hedonic control of eating. Neuron 36, 199-211.
242. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron 36, 241-263.
243. Schultz, W. (2007). Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259-288.
244. Schultz, W. (2010). Dopamine signals for reward value and risk: basic and recent data. Behav. Brain Funct. 6, 24.
245. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
246. Sedelis, M., Hofele, K., Auburger, G. W., Morgan, S., Huston, J. P., and Schwarting, R. K. (2000). MPTP susceptibility in the mouse: behavioral, neurochemical, and histological analysis of gender and strain differences. Behav. Genet. 30, 171-182.
247. Sesack, S. R., and Grace, A. A. (2010). Cortico-Basal Ganglia reward network: microcircuitry. Neuropsychopharmacology 35, 27-47.
248. Sipols, A. J., Stuber, G. D., Klein, S. N., Higgins, M. S., and Figlewicz, D. P. (2000). Insulin and raclopride combine to decrease short-term intake of sucrose solutions. Peptides 21, 1361-1367.
249. South, T., and Huang, X.-F. (2007). High-Fat Diet exposure increases dopamine D2 Receptor and decreases dopamine transporter receptor binding density in the nucleus accumbens and caudate putamen of mice. Neurochem. Res. 33, 598-605.
250. South, T., Westbrook, F., and Morris, M. J. (2012). Neurological and stress related effects of shifting obese rats from a palatable diet to chow and lean rats from chow to a palatable diet. Physiol. Behav. 105, 1052-1057.
251. Surmeier, D. J., Ding, J., Day, M., Wang, Z., and Shen, W. (2007). D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons. Trends Neurosci. 30, 228-235.
252. Sutton, R. S., and Barto, A. G. (1998). Introduction to Reinforcement Learning. Cambridge, MA: MIT Press.
253. Taylor, J. R., and Robbins, T. W. (1986). 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine. Psychopharmacology (Berl.) 90, 390-397.
254. Tindell, A. J., Berridge, K. C., Zhang, J., Peciña, S., and Aldridge, J. W. (2005). Ventral pallidal neurons code incentive motivation: amplification by mesolimbic sensitization and amphetamine. Eur. J. Neurosci. 22, 2617-2634.
255. Trinko, R., Sears, R. M., Guarnieri, D. J., and DiLeone, R. J. (2007). Neural mechanisms underlying obesity and drug addiction. Physiol. Behav. 91, 499-505.
256. Ugrumov, M. V., Saifetyarova, J. Y., Lavrentieva, A. V., and Sapronova, A. Y. (2012). Developing brain as an endocrine organ: secretion of dopamine. Mol. Cell. Endocrinol. 348, 78-86.
257. van de Wall, E., Leshan, R., Xu, A. W., Balthasar, N., Coppari, R., Liu, S. M., Jo, Y. H., MacKenzie, R. G., Allison, D. B., Dun, N. J., Elmquist, J., Lowell, B. B., Barsh, G. S., de Luca, C., Myers, M. G. Jr., Schwartz, G. J., and Chua, S. C. Jr. (2008). Collective and individual functions of leptin receptor modulated neurons controlling metabolism and ingestion. Endocrinology 149, 1773-1785.
258. Vanina, Y., Podolskaya, A., Sedky, K., Shahab, H., Siddiqui, A., Munshi, F., and Lippmann, S. (2002). Body weight changes associated with psychopharmacology. Psychiatr. Serv. 53, 842-847.
259. Viggiano, D. (2008). The hyperactive syndrome: metanalysis of genetic alterations, pharmacological treatments and brain lesions which increase locomotor activity. Behav. Brain Res. 194, 1-14.
260. Volkow, N. D., Fowler, J. S., and Wang, G. J. (2002). Role of dopamine in drug reinforcement and addiction in humans: results from imaging studies. Behav. Pharmacol. 13, 355-366.
261. Volkow, N. D., Wang, G. J., and Baler, R. D. (2010). Reward, dopamine and the control of food intake: implications for obesity. Trends Cogn. Sci. 15, 37-46.
262. Volkow, N. D., and Wise, R. A. (2005). How can drug addiction help us understand obesity? Nat. Neurosci. 8, 555-560.
263. Vucetic, Z., and Reyes, T. M. (2010). Central dopaminergic circuitry controlling food intake and reward: implications for the regulation of obesity. Wiley Interdiscip. Rev. Syst. Biol. Med. 2, 577-593.
264. Wagner, J. (2005). The reinforcing property and the rewarding aftereffect of wheel running in rats: a combination of two paradigms. Behav. Processes 68, 165-172.
265. Wang, G. J., Volkow, N. D., Logan, J., Pappas, N. R., Wong, C. T., Zhu, W., Netusil, N., and Fowler, J. S. (2001a). Brain dopamine and obesity. Lancet 357, 354-357.
266. Wang, J., Obici, S., Morgan, K., Barzilai, N., Feng, Z., and Rossetti, L. (2001b). Overfeeding rapidly induces leptin and insulin resistance. Diabetes 50, 2786-2791.
267. Wang, G.-J., Volkow, N. D., Thanos, P. K., and Fowler, J. S. (2004). Similarity between obesity and drug addiction as assessed by neurofunctional imaging: a concept review. J. Addict. Dis. 23, 39-53.
268. Warburton, D. E. R., Nicol, C. W., and Bredin, S. S. D. (2006). Health benefits of physical activity: the evidence. CMAJ 174, 801-809.
269. Wheeler, R. A., Aragona, B. J., Fuhrmann, K. A., Jones, J. L., Day, J. J., Cacciapaglia, F., Wightman, R. M., and Carelli, R. M. (2011). Cocaine cues drive opposing context-dependent shifts in reward processing and emotional state. Biol. Psychiatry 69, 1067-1074.
270. Williams, G., Bing, C., Cai, X. J., Harrold, J. A., King, P. J., and Liu, X. H. (2001). The hypothalamus and the control of energy homeostasis: different circuits, different purposes. Physiol. Behav. 74, 683-701.
271. Wilson, W. M., and Marsden, C. A. (1995). Extracellular dopamine in the nucleus accumbens of the rat during treadmill running. Acta Physiol. Scand. 155, 465-466.
272. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
273. Wise, R. A. (2009). Roles for nigrostriatal-not just mesocorticolimbic-dopamine in reward and addiction. Trends Neurosci. 32, 517-524.
274. Wise, R. A., Spindler, J., deWit, H., and Gerberg, G. J. (1978). Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science 201, 262-264.
275. Xu, M., Hu, X. T., Cooper, D. C., Moratalla, R., Graybiel, A. M., White, F. J., and Tonegawa, S. (1994). Elimination of cocaine-induced hyperactivity and dopamine-mediated neurophysiological effects in dopamine D1 receptor mutant mice. Cell 79, 945-955.
276. Yang, H. S., Shimomura, K., Vitaterna, M. H., and Turek, F. W. (2012). High-resolution mapping of a novel genetic locus regulating voluntary physical activity in mice. Genes Brain Behav. 11, 113-124.
277. Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476.
278. Yin, H. H., Ostlund, S. B., and Balleine, B. W. (2008). Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur. J. Neurosci. 28, 1437-1448.
279. Young, J. W., Goey, A. K. L., Minassian, A., Perry, W., Paulus, M. P., and Geyer, M. A. (2010). GBR 12909 administration as a mouse model of bipolar disorder mania: mimicking quantitative assessment of manic behavior. Psychopharmacology (Berl.) 208, 443-454.
280. Zachwieja, J. J., Hendry, S. L., Smith, S. R., and Harris, R. B. (1997). Voluntary wheel running decreases adipose tissue mass and expression of leptin mRNA in Osborne-Mendel rats. Diabetes 46, 1159-1166.
281. Zheng, H., and Berthoud, H.-R. (2007). Eating for pleasure or calories. Curr. Opin. Pharmacol. 7, 607-612.
282. Zheng, H., Lenard, N. R., Shin, A. C., and Berthoud, H.-R. (2009). Appetite control and energy balance regulation in the modern world: reward-driven brain overrides repletion signals. Int. J. Obes. (Lond.) 33(Suppl. 2), S8-S13.
283. Zhuang, X., Oosting, R. S., Jones, S. R., Gainetdinov, R. R., Miller, G. W., Caron, M. G., and Hen, R. (2001). Hyperactivity and impaired response habituation in hyperdopaminergic mice. Proc. Natl. Acad. Sci. U.S.A. 98, 1982-1987.