NOW vs LATER brain circuits: Implications for obesity and addiction

Trends in Neurosciences

Volumn 38, Issue 6, 2015, Pages 345-352

  Volkow, Nora D ^a   Baler, Ruben D ^a  

^a NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

Author keywords

Delay discounting; Dopamine; Intertemporal trade off; Striatum

Indexed keywords

DOPAMINE;

ADDICTION; BRAIN; HUMAN; INSULA; NEUROBIOLOGY; NOTE; OBESITY; ORBITAL CORTEX; PATHOLOGY; PRIORITY JOURNAL; SELF CONTROL; ANIMAL; DELAY DISCOUNTING; DRUG DEPENDENCE; METABOLISM; NERVE TRACT; PATHOPHYSIOLOGY; PHYSIOLOGY;

ANIMALS; BEHAVIOR, ADDICTIVE; BRAIN; DELAY DISCOUNTING; DOPAMINE; HUMANS; NEURAL PATHWAYS; OBESITY; SUBSTANCE-RELATED DISORDERS;

EID: 84942981611     PISSN: 01662236     EISSN: 1878108X     Source Type: Journal    
DOI: 10.1016/j.tins.2015.04.002     Document Type: Review

References (133)

1. Madden, G.J. et al. (2009) Pathological gamblers discount probabilistic rewards less steeply than matched controls. Exp. Clin. Psychopharmacol. 17, 283-290.
2. Nishiyama, R. (2014) Response effort discounts the subjective value of rewards. Behav. Process. 107C, 175-177.
3. Story, G.W. et al. (2014) Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective. Front. Behav. Neurosci. 8, 76.
4. Andrade, L.F. and Petry, N.M. (2012) Delay and probability discounting in pathological gamblers with and without a history of substance use problems. Psychopharmacology 219, 491-499.
5. Hamilton, K.R. and Potenza, M.N. (2012) Relations among delay discounting, addictions, and money mismanagement: implications and future directions. Am. J. Drug Alcohol Abuse 38, 30-42.
6. Costa Dias, T.G. et al. (2013) Reward circuit connectivity relates to delay discounting in children with attention-deficit/hyperactivity disorder. Eur. Neuropsychopharmacol. 23, 33-45.
7. Epstein, L.H. et al. (2010) Food reinforcement, delay discounting and obesity. Physiol. Behav. 100, 438-445.
8. MacKillop, J. (2013) Integrating behavioral economics and behavioral genetics: delayed reward discounting as an endophenotype for addictive disorders. J. Exp. Anal. Behav. 99, 14-31.
9. Reynolds, B. (2006) A review of delay-discounting research with humans: relations to drug use and gambling. Behav. Pharmacol. 17, 651-667.
10. Takahashi, T. et al. (2008) Depressive patients are more impulsive and inconsistent in intertemporal choice behavior for monetary gain and loss than healthy subjects-an analysis based on Tsallis' statistics. Neuroendocrinol. Lett. 29, 351-358.
11. Bixter, M.T. and Luhmann, C.C. (2013) Adaptive intertemporal preferences in foraging-style environments. Front. Neurosci. 7, 93.
12. Peters, J. and Buchel, C. (2011) The neural mechanisms of intertemporal decision-making: understanding variability. Trends Cogn. Sci. 15, 227-239.
13. Carter, E.C. et al. (2015) Reassessing intertemporal choice: human decision-making is more optimal in a foraging task than in a selfcontrol task. Front. Psychol. 6, 95.
14. Basar, K. et al. (2010) Nucleus accumbens and impulsivity. Prog. Neurobiol. 92, 533-557.
15. Stojek, M.M. et al. (2014) The role of impulsivity traits and delayed reward discounting in dysregulated eating and drinking among heavy drinkers. Appetite 80, 81-88.
16. Whiteside, S.P. and Lynam, D.R. (2001) The Five Factor Model and impulsivity: using a structural model of personality to understand impulsivity. Pers. Individ. Dif. 30, 669-689.
17. Winstanley, C.A. et al. (2006) Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. Cereb. Cortex 16, 106-114.
18. Paterson, N.E. et al. (2012) Impulsive action and impulsive choice are mediated by distinct neuropharmacological substrates in rat. Int. J. Neuropsychopharmacol. 15, 1473-1487.
19. Baarendse, P.J. and Vanderschuren, L.J. (2012) Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats. Psychopharmacology 219, 313-326.
20. Floresco, S.B. et al. (2008) Dopaminergic and glutamatergic regulation of effort-and delay-based decision making. Neuropsychopharmacology 33, 1966-1979.
21. Cardinal, R.N. (2006) Neural systems implicated in delayed and probabilistic reinforcement. Neural Netw. 19, 1277-1301.
22. Volkow, N.D. et al. (2014) Stimulant-induced dopamine increases are markedly blunted in active cocaine abusers. Mol. Psychiatry 19, 1037-1043.
23. Volkow, N.D. et al. (2001) Therapeutic doses of oral methylphenidate significantly increase extracellular dopamine in the human brain. J. Neurosci. 21, RC121.
24. Fowler, J.S. et al. (2008) Fast uptake and long-lasting binding of methamphetamine in the human brain: comparison with cocaine. Neuroimage 43, 756-763.
25. Volkow, N.D. et al. (2004) Evidence that methylphenidate enhances the saliency of a mathematical task by increasing dopamine in the human brain. Am. J. Psychiatry 161, 1173-1180.
26. 3 receptors mediate response inhibition and related activity in frontostriatal neural circuitry in humans. J. Neurosci. 32, 7316-7324.
27. Robinson, E.S. et al. (2009) Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: specific deficits in 'waiting' versus 'stopping'. Behav. Brain Res. 196, 310-316.
28. Tricomi, E. et al. (2009) A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci. 29, 2225-2232.
29. Coull, J.T. et al. (1998) Monitoring for target objects: activation of right frontal and parietal cortices with increasing time on task. Neuropsychologia 36, 1325-1334.
30. Pardo, J.V. et al. (1991) Localization of a human system for sustained attention by positron emission tomography. Nature 349, 61-64.
31. Jimura, K. et al. (2013) Impulsivity and self-control during intertemporal decision making linked to the neural dynamics of reward value representation. J. Neurosci. 33, 344-357.
32. Mailly, P. et al. (2013) The rat prefrontostriatal system analyzed in 3D: evidence for multiple interacting functional units. J. Neurosci. 33, 5718-5727.
33. Brooks, A.M. and Berns, G.S. (2013) Aversive stimuli and loss in the mesocorticolimbic dopamine system. Trends Cogn. Sci. 17, 281-286.
34. Wager, T.D. et al. (2004) Placebo-induced changes in FMRI in the anticipation and experience of pain. Science 303, 1162-1167.
35. Essex, B.G. et al. (2012) The impact of the posterior parietal and dorsolateral prefrontal cortices on the optimization of long-term versus immediate value. J. Neurosci. 32, 15403-15413.
36. McClure, S.M. et al. (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306, 503-507.
37. Sellitto, M. et al. (2011) The neurobiology of intertemporal choice: insight from imaging and lesion studies. Rev. Neurosci. 22, 565-574.
38. Seymour, B. et al. (2004) Temporal difference models describe higherorder learning in humans. Nature 429, 664-667.
39. Kable, J.W. and Glimcher, P.W. (2010) An ''as soon as possible'' effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J. Neurophysiol. 103, 2513-2531.
40. Bermudez, M.A. and Schultz, W. (2014) Timing in reward and decision processes. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 369, 20120468.
41. Abler, B. et al. (2006) Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage 31, 790-795.
42. Spicer, J. et al. (2007) Sensitivity of the nucleus accumbens to violations in expectation of reward. Neuroimage 34, 455-461.
43. Kalivas, P.W. et al. (1993) GABA and enkephalin projection from the nucleus accumbens and ventral pallidum to the ventral tegmental area. Neuroscience 57, 1047-1060.
44. Schultz, W. (2007) Behavioral dopamine signals. Trends Neurosci. 30, 203-210.
45. Wise, R.A. (2002) Brain reward circuitry: insights from unsensed incentives. Neuron 36, 229-240.
46. St Onge, J.R. et al. (2012) Dynamic fluctuations in dopamine efflux in the prefrontal cortex and nucleus accumbens during risk-based decision making. J. Neurosci. 32, 16880-16891.
47. Val/Val genotype. J. Neurosci. 27, 14383-14391.
48. Stanger, C. et al. (2013) Neuroeconomics and adolescent substance abuse: individual differences in neural networks and delay discounting. J. Am. Acad. Child Adolesc. Psychiatry 52, 747-755.
49. Kober, H. et al. (2010) Prefrontal-striatal pathway underlies cognitive regulation of craving. Proc. Natl. Acad. Sci. U.S.A. 107, 14811-14816.
50. Volkow, N.D. et al. (2010) Cognitive control of drug craving inhibits brain reward regions in cocaine abusers. Neuroimage 49, 2536-2543.
51. Floresco, S.B. and Magyar, O. (2006) Mesocortical dopamine modulation of executive functions: beyond working memory. Psychopharmacology 188, 567-585.
52. St Onge, J.R. et al. (2011) Dissociable contributions by prefrontal D1 and D2 receptors to risk-based decision making. J. Neurosci. 31, 8625-8633.
53. Stopper, C.M. et al. (2013) Receptor-specific modulation of risk-based decision making by nucleus accumbens dopamine. Neuropsychopharmacology 38, 715-728.
54. Stopper, C.M. and Floresco, S.B. (2015) Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia. Schizophr. Bull. 41, 9-14.
55. Maia, T.V. and Frank, M.J. (2011) From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 14, 154-162.
56. Fiorentini, C. et al. (2010) Dimerization of dopamine D1 and D3 receptors in the regulation of striatal function. Curr. Opin. Pharmacol. 10, 87-92.
57. Reist, C. et al. (2007) Novelty seeking and the dopamine D4 receptor gene (DRD4) revisited in Asians: haplotype characterization and relevance of the 2-repeat allele. Am. J. Med. Genet. B: Neuropsychiatr. Genet. 144B, 453-457.
58. Tsuchimine, S. et al. (2009) Minor genetic variants of the dopamine D4 receptor (DRD4) polymorphism are associated with novelty seeking in healthy Japanese subjects. Prog. Neuropsychopharmacol. Biol. Psychiatry 33, 1232-1235.
59. Simon, N.W. et al. (2013) Prefrontal cortical-striatal dopamine receptor mRNA expression predicts distinct forms of impulsivity. Eur. J. Neurosci. 37, 1779-1788.
60. Day, J.J. et al. (2010) Phasic nucleus accumbens dopamine release encodes effort-and delay-related costs. Biol. Psychiatry 68, 306-309.
61. Howe, M.W. et al. (2013) Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500, 575-579.
62. Niv, Y. et al. (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191, 507-520.
63. Missale, C. et al. (1998) Dopamine receptors: from structure to function. Physiol. Rev. 78, 189-225.
64. Beaulieu, J.M. and Gainetdinov, R.R. (2011) The physiology, signaling, and pharmacology of dopamine receptors. Pharmacol. Rev. 63, 182-217.
65. Bromberg-Martin, E.S. and Hikosaka, O. (2011) Lateral habenula neurons signal errors in the prediction of reward information. Nat. Neurosci. 14, 1209-1216.
66. Lebreton, M. et al. (2013) A critical role for the hippocampus in the valuation of imagined outcomes. PLoS Biol. 11, e1001684.
67. LeDoux, J. (2007) The amygdala. Curr. Biol. 17, R868-R874.
68. Gallagher, M. (2000) The amygdala and associative learning. In The Amygdala: A Functional Analysis (Aggleton, J.P., ed.), pp. 311-329, Oxford University Press.
69. Velasquez, K.M. et al. (2014) The role of the habenula in drug addiction. Front. Hum. Neurosci. 8, 174.
70. Matsumoto, M. and Hikosaka, O. (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111-1115.
71. Lecourtier, L. et al. (2008) Differential tonic influence of lateral habenula on prefrontal cortex and nucleus accumbens dopamine release. Eur. J. Neurosci. 27, 1755-1762.
72. Rolls, E.T. (2013) A biased activation theory of the cognitive and attentional modulation of emotion. Front. Hum. Neurosci. 7, 74.
73. Stice, E. et al. (2009) Relation of obesity to consummatory and anticipatory food reward. Physiol. Behav. 97, 551-560.
74. Kahnt, T. et al. (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 107, 6010-6015.
75. Peters, J. and Buchel, C. (2010) Neural representations of subjective reward value. Behav. Brain Res. 213, 135-141.
76. Volkow, N.D. and Fowler, J.S. (2000) Addiction, a disease of compulsion and drive: involvement of the orbitofrontal cortex. Cereb. Cortex 10, 318-325.
77. van Veen, V. and Carter, C.S. (2002) The anterior cingulate as a conflict monitor: fMRI and ERP studies. Physiol. Behav. 77, 477-482.
78. Klavir, O. et al. (2013) Functional connectivity between amygdala and cingulate cortex for adaptive aversive learning. Neuron 80, 1290-1300.
79. Holroyd, C.B. and Coles, M.G. (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709.
80. Wiebking, C. et al. (2014) GABA in the insula-a predictor of the neural response to interoceptive awareness. Neuroimage 86, 10-18.
81. Dambacher, F. et al. (2014) Out of control: evidence for anterior insula involvement in motor impulsivity and reactive aggression. Soc. Cogn. Affect. Neurosci. 10, 508-516.
82. Volkow, N.D. et al. (2009) Imaging dopamine's role in drug abuse and addiction. Neuropharmacology 56 (Suppl. 1), 3-8.
83. Winstanley, C.A. et al. (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J. Neurosci. 24, 4718-4722.
84. Kobayashi, Y. et al. (2013) Genetic dissection of medial habenula-interpeduncular nucleus pathway function in mice. Front. Behav. Neurosci. 7, 17.
85. Goudriaan, A.E. et al. (2014) Getting a grip on problem gambling: what can neuroscience tell us? Front. Behav. Neurosci. 8, 141.
86. Tomasi, D. and Volkow, N.D. (2013) Striatocortical pathway dysfunction in addiction and obesity: differences and similarities. Crit. Rev. Biochem. Mol. Biol. 48, 1-19.
87. van Holst, R.J. et al. (2014) Striatal connectivity changes following gambling wins and near-misses: associations with gambling severity. Neuroimage Clin. 5, 232-239.
88. Irvine, M.A. et al. (2013) Impaired decisional impulsivity in pathological videogamers. PLoS ONE 8, e75914.
89. Pulcu, E. et al. (2014) Temporal discounting in major depressive disorder. Psychol. Med. 44, 1825-1834.
90. Ahn, W.Y. et al. (2011) Temporal discounting of rewards in patients with bipolar disorder and schizophrenia. J. Abnorm. Psychol. 120, 911-921.
91. Bickel, W.K. et al. (2012) Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other diseaserelated vulnerabilities: emerging evidence. Pharmacol. Ther. 134, 287-297.
92. Csete, M. and Doyle, J. (2004) Bow ties, metabolism and disease. Trends Biotechnol. 22, 446-450.
93. Volkow, N.D. et al. (2013) The addictive dimensionality of obesity. Biol. Psychiatry 73, 811-818.
94. Fergusson, D.M. et al. (2013) Childhood self-control and adult outcomes: results from a 30-year longitudinal study. J. Am. Acad. Child Adolesc. Psychiatry 52, 709-717.
95. Moffitt, T.E. et al. (2011) A gradient of childhood self-control predicts health, wealth, and public safety. Proc. Natl. Acad. Sci. U.S.A. 108, 2693-2698.
96. Mischel, W. et al. (2011) 'Willpower' over the life span: decomposing self-regulation. Soc. Cogn. Affect. Neurosci. 6, 252-256.
97. Greenberg, M.T. (2006) Promoting resilience in children and youth: preventive interventions and their interface with neuroscience. Ann. N. Y. Acad. Sci. 1094, 139-150.
98. Rutter, M. (2013) Annual research review: resilience-clinical implications. J. Child Psychol. Psychiatry 54, 474-487.
99. Stevens, L. et al. (2015) Delay discounting, treatment motivation and treatment retention among substance-dependent individuals attending an in inpatient detoxification program. J. Subst. Abuse Treat. 49, 58-64.
100. Decker, J.H. et al. (2014) On weight and waiting: delay discounting in anorexia nervosa pretreatment and posttreatment. Biol. Psychiatry Published online December 23, 2014. http://dx.doi.org/10.1016/j.biopsych.2014.12.016.
101. Koffarnus, M.N. et al. (2013) Changing delay discounting in the light of the competing neurobehavioral decision systems theory: a review. J. Exp. Anal. Behav. 99, 32-57.
102. Darlington, T.M. et al. (2014) Mesolimbic transcriptional response to hedonic substitution of voluntary exercise and voluntary ethanol consumption. Behav. Brain Res. 259, 313-320.
103. Wansink, B. et al. (2012) Attractive names sustain increased vegetable intake in schools. Prev. Med. 55, 330-332.
104. Schonberg, T. et al. (2014) Influencing food choices by training: evidence for modulation of frontoparietal control signals. J. Cogn. Neurosci. 26, 247-268.
105. Tang, Y.Y. and Posner, M.I. (2014) Training brain networks and states. Trends Cogn. Sci. 18, 345-350.
106. Baumeister, R.F. (2014) Self-regulation, ego depletion, and inhibition. Neuropsychologia 65, 313-319.
107. Dang, J. et al. (2014) Self-control depletion is more than motivational switch from work to fun: the indispensable role of cognitive adaptation. Front. Psychol. 5, 933.
108. Magen, E. et al. (2014) Behavioral and neural correlates of increased self-control in the absence of increased willpower. Proc. Natl. Acad. Sci. U.S.A. 111, 9786-9791.
109. Paulus, M.P. et al. (2009) The role of interoception and alliesthesia in addiction. Pharmacol. Biochem. Behav. 94, 1-7.
110. Dickenson, J. et al. (2013) Neural correlates of focused attention during a brief mindfulness induction. Soc. Cogn. Affect. Neurosci. 8, 40-47.
111. Williamson, J.W. et al. (1999) Activation of the insular cortex is affected by the intensity of exercise. J. Appl. Physiol. 87, 1213-1219.
112. Paulus, M.P. et al. (2013) Treatment approaches for interoceptive dysfunctions in drug addiction. Front. Psychiatry 4, 137.
113. Hanlon, C.A. et al. (2013) Reduction of cue-induced craving through realtime neurofeedback in nicotine users: the role of region of interest selection and multiple visits. Psychiatry Res. 213, 79-81.
114. Steigerwald, F. and Stone, D. (1999) Cognitive restructuring and the 12-step program of alcoholics anonymous. J. Subst. Abuse Treat. 16, 321-327.
115. Maas, J. et al. (2013) Changing automatic behavior through selfmonitoring: does overt change also imply implicit change? J. Behav. Ther. Exp. Psychiatry 44, 279-284.
116. Ritter, V. et al. (2013) Changes in implicit and explicit self-esteem following cognitive and psychodynamic therapy in social anxiety disorder. Psychother. Res. 23, 547-558.
117. Haase, L. et al. (2014) Mindfulness-based training attenuates insula response to an aversive interoceptive challenge. Soc. Cogn. Affect. Neurosci. Published online April 8, 2014. http://dx.doi.org/10.1093/scan/nsu042.
118. Fecteau, S. et al. (2007) Diminishing risk-taking behavior by modulating activity in the prefrontal cortex: a direct current stimulation study. J. Neurosci. 27, 12500-12505.
119. Cho, S.S. et al. (2014) Investing in the future: stimulation of the medial prefrontal cortex reduces discounting of delayed rewards. Neuropsychopharmacology 40, 546-553.
120. Fujita, K. and Carnevale, J. (2012) Transcending temptation through abstraction: the role of construal level in self control. Curr. Dir. Psychol. Sci. 21, 248-252.
121. Chiou, W.B. et al. (2013) Think abstractly, smoke less: a brief construal-level intervention can promote self-control, leading to reduced cigarette consumption among current smokers. Addiction 108, 985-992.
122. Liu, L. et al. (2012) Adapting to the destitute situations: poverty cues lead to short-term choice. PLoS ONE 7, e33950.
123. Kalousova, L. and Burgard, S.A. (2013) Debt and foregone medical care. J. Health Soc. Behav. 54, 204-220.
124. Sonuga-Barke, E.J. (2014) Reward: commentary. Temporal discounting in conduct disorder: toward an experience-adaptation hypothesis of the role of psychosocial insecurity. J. Pers. Disord. 28, 19-24.
125. White, S.F. et al. (2014) Reward: empirical contribution. Temporal discounting and conduct disorder in adolescents. J. Pers. Disord. 28, 5-18.
126. Brenhouse, H.C. et al. (2013) Early life adversity alters the developmental profiles of addiction-related prefrontal cortex circuitry. Brain Sci. 3, 143-158.
127. Burton, C.L. et al. (2007) Prenatal restraint stress and motherless rearing disrupts expression of plasticity markers and stress-induced corticosterone release in adult female Sprague-Dawley rats. Brain Res. 1158, 28-38.
128. Liberman, N. and Trope, Y. (2008) The psychology of transcending the here and now. Science 322, 1201-1205.
129. Ronteltap, A. et al. (2012) Construal levels of healthy eating. Exploring consumers' interpretation of health in the food context. Appetite 59, 333-340.
130. Grabenhorst, F. et al. (2013) Food labels promote healthy choices by a decision bias in the amygdala. Neuroimage 74, 152-163.
131. Simpson, E.H. et al. (2014) Genetic variation in COMT activity impacts learning and dopamine release capacity in the striatum. Learn. Mem. 21, 205-214.
132. Sebastian, A. et al. (2014) Frontal dysfunctions of impulse control-a systematic review in borderline personality disorder and attentiondeficit/hyperactivity disorder. Front. Hum. Neurosci. 8, 698.
133. Hollon, N.G. et al. (2014) Dopamine-associated cached values are not sufficient as the basis for action selection. Proc. Natl. Acad. Sci. U.S.A. 111, 18357-18362.