Individual differences in nucleus accumbens dopamine receptors predict development of addiction-like behavior: A computational approach

Neural Computation

Volumn 22, Issue 9, 2010, Pages 2334-2368

  Piray, Payam ^a   Keramati, Mohammad Mahdi ^b   Dezfouli, Amir ^a   Lucas, Caro ^a   Mokri, Azarakhsh ^c,d  

^a UNIVERSITY OF TEHRAN   (Iran)

^b SHARIF UNIVERSITY OF TECHNOLOGY   (Iran)

^c TEHRAN UNIVERSITY OF MEDICAL SCIENCES   (Iran)

^d TEHRAN UNIVERSITY OF MEDICAL SCIENCES   (Iran)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE RECEPTOR;

ADDICTION; BIOLOGICAL MODEL; COMPUTER SIMULATION; HUMAN; INDIVIDUALITY; LETTER; NERVE CELL NETWORK; NUCLEUS ACCUMBENS; PATHOPHYSIOLOGY; PHYSIOLOGY; REINFORCEMENT;

BEHAVIOR, ADDICTIVE; COMPUTER SIMULATION; HUMANS; INDIVIDUALITY; MODELS, NEUROLOGICAL; NERVE NET; NUCLEUS ACCUMBENS; RECEPTORS, DOPAMINE; REINFORCEMENT (PSYCHOLOGY);

EID: 78149353015     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00009     Document Type: Letter

References (143)

1. Ahmed, S. H. (2004). Addiction as compulsive reward prediction. Science, 306(5703), 1901-1902.
2. Ahmed, S. H. (2008). The origin of addictions by means of unnatural decision. Behavioral and Brain Sciences, 31(4), 437-438.
3. Ahmed, S. H., & Koob, G. F. (1998). Transition from moderate to excessive drug intake: Change in hedonic set point. Science, 282(5387), 298-300.
4. Ahmed, S. H., & Koob, G. F. (2005). Transition to drug addiction: A negative reinforcement model based on an allostatic decrease in reward function. Psychopharmacology, 180(3), 473-490.
5. American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders (4th ed.). Washington, DC: Author.
6. Anthony, J. C., Warner, L. A., & Kessler, R. C. (1994). Comparative epidemiology of dependence on tobacco, alcohol, controlled substances, and inhalants: Basic findings from the National Comorbidity Survey. Experimental and Clinical Psychopharmacology, 2(3), 244-268.
7. Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007). Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nature Neuroscience, 10(1), 126-131.
8. Bachtell, R. K., Whisler, K., Karanian, D., & Self, D. W. (2005). Effects of intranucleus accumbens shell administration of dopamine agonists and antagonists on cocaine-taking and cocaine-seeking behaviors in the rat. Psychopharmacology, 183(1), 41-53.
9. Balleine, B.W., Delgado,M. R., & Hikosaka, O. (2007). The role of the dorsal striatum in reward and decision-making. Journal of Neuroscience, 27(31), 8161-8165.
10. Bayer, H. M., & Glimcher, P.W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47(1), 129-141.
11. Belin, D., & Everitt, B. J. (2008). Cocaine seeking habits depend upon dopaminedependent serial connectivity linking the ventral with the dorsal striatum. Neuron, 57(3), 432-441.
12. Belin, D., Mar, A. C., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2008). High impulsivity predicts the switch to compulsive cocaine-taking. Science, 320(5881), 1352-1355.
13. Berke, J. D., & Hyman, S. E. (2000). Addiction, dopamine, and the molecular mechanisms of memory. Neuron, 25(3), 515-532.
14. Beveridge, T. J. R., Smith, H. R.,Nader,M.A.,&Porrino, L. J. (2009).Abstinence from chronic cocaine self-administration alters striatal dopamine systems in rhesus monkeys. Neuropsychopharmacology, 34(5), 1162-1171.
15. Bolanos, C. A., Perrotti, L. I., Edwards, S., Eisch, A. J., Barrot, M., Olson, V. G., et al. (2003). Phospholipase C γ in distinct regions of the ventral tegmental area differentially modulates mood-related behaviors. J. Neurosci., 23(20), 7569-7576.
16. Brischoux, F., Chakraborty, S., Brierley, D. I., & Ungless, M. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proceedings of the National Academy of Sciences of the United States of America, 106(12), 4894-4899.
17. Caine, S. B., Negus, S. S., Mello, N. K., & Bergman, J. (1999). Effects of dopamine D(1-like) and D(2-like) agonists in rats that self-administer cocaine. Journal of Pharmacology and Experimental Therapeutics, 291(1), 353-360.
18. Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience and Biobehavioral Reviews, 26(3), 321-352.
19. Carelli, R. M. (2002). Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. "natural" reinforcement. Physiology and Behavior, 76(3), 379-387.
20. Carlezon, W. A., Boundy, V. A., Haile, C. N., Lane, S. B., Kalb, R. G., Neve, R. L., et al. (1997). Sensitization to morphine induced by viral-mediated gene transfer. Science, 277(5327), 812-815.
21. Carlezon,W.A., Devine,D. P.,&Wise, R. A. (1995).Habit-forming actions of nomifensine in nucleus accumbens. Psychopharmacology, 122(2), 194-197.
22. Carlezon,W. A., Haile, C.N., Coppersmith, R.,Hayashi, Y., Malinow, R., Neve, R. L., et al. (2000). Distinct sites of opiate reward and aversion within the midbrain identified using a herpes simplex virus vector expressing GluR1. J. Neurosci., 20(5), 62RC.
23. Conrad, K. L., Tseng, K. Y., Uejima, J. L., Reimers, J. M., Heng, L., Shaham, Y., et al. (2008). Formation of accumbens GluR2-lacking AMPA receptors mediates incubation of cocaine craving. Nature, 454(7200), 118-121.
24. Corrigall, W. A., & Coen, K. M. (1991). Cocaine self-administration is increased by both D1 and D2 dopamine antagonists. Pharmacology, Biochemistry, and Behavior, 39(3), 799-802.
25. Dagher, A., & Robbins, T.W. (2009). Personality, addiction, dopamine: Insights from Parkinson's disease. Neuron, 61(4), 502-510.
26. Dalley, J.W., Fryer, T. D., Brichard, L., Robinson, E. S. J., Theobald, D. E.H., Lääne, et al. (2007). Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science, 315(5816), 1267-1270.
27. Daw, N. D., Kakade, S.,&Dayan, P. (2002).Opponent interactions between serotonin and dopamine. Neural Networks, 15(4-6), 603-616.
28. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8(12), 1704-1711.
29. Dayan, P. (2009). Dopamine, reinforcement learning, and addiction. Pharmacopsychiatry, 42 (Suppl. 1), S56-65.
30. Dayan, P., & Huys, Q. J. M. (2008). Serotonin, inhibition, and negative mood. PLoS Computational Biology, 4(2), e4.
31. Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004). Evidence for addiction-like behavior in the rat. Science, 305(5686), 1014-1017.
32. de Wit, H., Uhlenhuth, E. H., & Johanson, C. E. (1986). Individual differences in the reinforcing and subjective effects of amphetamine and diazepam. Drug and Alcohol Dependence, 16(4), 341-360.
33. Dezfouli, A., Piray, P., Keramati, M. M., Ekhtiari, H., Lucas, C., & Mokri, A. (2009). A Neurocomputational Model for Cocaine Addiction. Neural Computation, 21, 2869-2893.
34. Di Chiara, G., Bassareo, V., Fenu, S., De Luca, M. A., Spina, L., Cadoni, C., et al. (2004). Dopamine and drug addiction: The nucleus accumbens shell connection. Neuropharmacology, 47 (Suppl. 1), 227-241.
35. Edwards, S.,Whisler,K.N., Fuller, D. C.,Orsulak, P. J.,&Self, D.W. (2007).Addictionrelated alterations in D1 and D2 dopamine receptor behavioral responses following chronic cocaine self-administration. Neuropsychopharmacology, 32(2), 354-366.
36. Everitt, B. J., Belin, D., Economidou, D., Pelloux, Y., Dalley, J. W., & Robbins, T. W. (2008). Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 363(1507), 3125-3135.
37. Everitt, B. J., & Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: Fromactions to habits to compulsion. Nature Neuroscience, 8(11), 1481-1489.
38. Fenu, S., Spina, L., Rivas, E., Longoni, R., & Di Chiara, G. (2006). Morphineconditioned single-trial place preference: Role of nucleus accumbens shell dopamine receptors in acquisition, but not expression. Psychopharmacology, 187(2), 143-153.
39. Ford, C. P., Mark, G. P., & Williams, J. T. (2006). Properties and opioid inhibition of mesolimbic dopamine neurons vary according to target location. J. Neurosci., 26(10), 2788-2797.
40. Frank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12(8), 1062-1068.
41. Frank, M. J.,Moustafa, A. A., Haughey, H.M., Curran, T., & Hutchison, K. E. (2007). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of the National Academy of Sciences of the United States of America, 104(41), 16311-16316.
42. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in Parkinsonism. Science, 306(5703), 1940-1943.
43. Frank, M. J., & Surmeier, D. J. (2009). Do substantia nigra dopaminergic neurons differentiate between reward and punishment? Journal of Molecular Cell Biology, 1(1), 15-16.
44. Garavan, H., Pankiewicz, J., Bloom, A., Cho, J. K., Sperry, L., Ross, T. J., et al. (2000). Cue-induced cocaine craving: Neuroanatomical specificity for drug users and drug stimuli. American Journal of Psychiatry, 157(11), 1789-1798.
45. Goldstein, R. Z., Alia-Klein, N., Tomasi, D., Zhang, L., Cottone, L. A., Maloney, T., et al. (2007). Is decreased prefrontal cortical sensitivity to monetary reward associated with impaired motivation and self-control in cocaine addiction? American Journal of Psychiatry, 164(1), 43-51.
46. Goto, Y., & Grace, A. A. (2005). Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nature Neuroscience, 8(6), 805-812.
47. Gutkin, B. S., Dehaene, S., & Changeux, J. (2006). A neurocomputational hypothesis for nicotine addiction. Proceedings of the National Academy of Sciences of the United States of America, 103(4), 1106-1111.
48. Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci., 20(6), 2369-2382.
49. Haber, S. N., & Knutson, B. (2009). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology, 35, 4-26.
50. Hazy, T. E., Frank, M. J., & O'Reilly, R. C. (2007). Towards an executive without a homunculus: Computational models of the prefrontal cortex/basal ganglia system. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 362(1485), 1601-1613.
51. Hopf, F.W., Cascini, M. G., Gordon, A. S., Diamond, I., & Bonci, A. (2003). Cooperative activation of dopamine D1 and D2 receptors increases spike firing of nucleus accumbens neurons via G-protein betagamma subunits. Journal of Neuroscience, 23(12), 5079-5087.
52. Hyman, S. E. (2005). Addiction: A disease of learning and memory. American Journal of Psychiatry, 162(8), 1414-1422.
53. Hyman, S. E.,Malenka, R. C.,&Nestler, E. J. (2006).Neuralmechanisms of addiction: The role of reward-related learning and memory. Annual Review of Neuroscience, 29, 565-598.
54. Ikemoto, S. (2003). Involvement of the olfactory tubercle in cocaine reward: Intracranial self-administration studies. J. Neurosci., 23(28), 9305-9311.
55. Ikemoto, S. (2007). Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Research Reviews, 56(1), 27-78.
56. Ikemoto, S., Glazier, B. S., Murphy, J. M., & McBride, W. J. (1997). Role of dopamine D1 and D2 receptors in the nucleus accumbens in mediating reward. J. Neurosci., 17(21), 8580-8587.
57. Ikemoto, S., Murphy, J. M., & McBride, W. J. (1998). Regional differences within the rat ventral tegmental area formuscimol self-infusions. Pharmacology, Biochemistry, and Behavior, 61(1), 87-92.
58. Ikemoto, S., Qin, M., & Liu, Z. (2005). The functional divide for primary reinforcement of D-amphetamine lies between the medial and lateral ventral striatum: Is the division of the accumbens core, shell, and olfactory tubercle valid? Journal of Neuroscience, 25(20), 5061-5065.
59. Ikemoto, S., &Wise, R. A. (2002). Rewarding effects of the cholinergic Agents carbachol and neostigmine in the posterior ventral tegmental area. J. Neurosci., 22(22), 9895-9904.
60. Inoue, Y., Yao, L., Hopf, F. W., Fan, P., Jiang, Z., Bonci, A., et al. (2007). Nicotine and ethanol activate protein kinase a synergistically via Gi beta ( subunits in nucleus accumbens/ventral tegmental cocultures: The role of dopamine D1/D2 and adenosine A2A receptors. J. Pharmacol. Exp. Ther., 322(1), 23-29.
61. Ito, M., & Doya, K. (2009). Validation of decision-making models and analysis of decision variables in the rat basal ganglia. Journal of Neuroscience, 29(31), 9861-9874.
62. Ito, R., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2002). Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drugassociated cue. Journal of Neuroscience, 22(14), 6247-6253.
63. Janak, P. H., Chen, M., & Caulder, T. (2004). Dynamics of neural coding in the accumbens during extinction and reinstatement of rewarded behavior. Behavioural Brain Research, 154(1), 125-135.
64. Jentsch, J. D., Olausson, P., De La Garza, R., & Taylor, J. R. (2002). Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys. Neuropsychopharmacology, 26(2), 183-190.
65. Kalivas, P. W. (2009). The glutamate homeostasis hypothesis of addiction. Nature Reviews. Neuroscience, 10(8), 561-572.
66. Kalivas, P. W., & O'Brien, C. P. (2008). Drug addiction as a pathology of staged neuroplasticity. Neuropsychopharmacology, 33(1), 166-180.
67. Kauer, J. A., & Malenka, R. C. (2007). Synaptic plasticity and addiction. Nature Reviews. Neuroscience, 8(11), 844-858.
68. Kim, H., Sul, J.H., Huh, N., Lee, D.,&Jung,M.W. (2009). Role of striatum in updating values of chosen actions. Journal of Neuroscience, 29(47), 14701-14712.
69. Kim, Y. B., Huh, N., Lee, H., Baeg, E. H., Lee, D., & Jung, M. W. (2007). Encoding of action history in the rat ventral striatum. Journal of Neurophysiology, 98(6), 3548-3556.
70. Klein, T. A., Neumann, J., Reuter, M., Hennig, J., von Cramon, D. Y., & Ullsperger, M. (2007). Genetically determined differences in learning from errors. Science, 318(5856), 1642-1645.
71. Koob, G. F., & Le Moal, M. (2005). Plasticity of reward neurocircuitry and the "dark side" of drug addiction. Nature Neuroscience, 8(11), 1442-1444.
72. Laruelle,M., D'Souza, C. D., Baldwin, R. M., Abi-Dargham, A., Kanes, S. J., Fingado, C. L., et al. (1997). Imaging D2 receptor occupancy by endogenous dopamine in humans. Neuropsychopharmacology, 17(3), 162-174.
73. Lau, B., & Glimcher, P. W. (2008). Value representations in the primate striatum during matching behavior. Neuron, 58(3), 451-463.
74. Lauwereyns, J., Watanabe, K., Coe, B., & Hikosaka, O. (2002). A neural correlate of response bias in monkey caudate nucleus. Nature, 418(6896), 413-417.
75. Mach, R. H., Nader, M. A., Ehrenkaufer, R. L., Line, S. W., Smith, C. R., Gage, H. D., et al. (1997). Use of positron emission tomography to study the dynamics of psychostimulant-induced dopamine release. Pharmacology, Biochemistry, and Behavior, 57(3), 477-486.
76. Mameli, M., Halbout, B., Creton, C., Engblom, D., Parkitna, J. R., Spanagel, R., & Lüscher, C. (2009). Cocaine-evoked synaptic plasticity: Persistence in the VTA triggers adaptations in the NAc. Nature Neuroscience, 12(8), 1036-1041.
77. Martinez, D., Slifstein, M., Narendran, R., Foltin, R. W., Broft, A., Hwang, D., et al. (2009). Dopamine D1 receptors in cocaine dependence measured with PET and the choice to self-administer cocaine. Neuropsychopharmacology, 34(7), 1774-1782.
78. Matsumoto, M., & Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature, 459(7248), 837-841.
79. McClure, S. M., Daw, N. D., &Montague, P. R. (2003). A computational substrate for incentive salience. Trends in Neurosciences, 26(8), 423-428.
80. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16(5), 1936-1947.
81. Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004). Computational roles for dopamine in behavioural control. Nature, 431(7010), 760-767.
82. Moore, R. J., Vinsant, S. L., Nader, M. A., Porrino, L. J., & Friedman, D. P. (1998). Effect of cocaine self-administration on striatal dopamine D1 receptors in rhesus monkeys. Synapse, 28(1), 1-9.
83. Morgan, D., Grant, K. A., Gage, H. D., Mach, R. H., Kaplan, J. R., Prioleau, O., et al. (2002). Social dominance in monkeys: Dopamine D2 receptors and cocaine self-administration. Nature Neuroscience, 5(2), 169-174.
84. Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006). Midbrain dopamine neurons encode decisions for future action. Nature Neuroscience, 9(8), 1057-1063.
85. Moustafa, A. A., Cohen, M. X., Sherman, S. J., & Frank, M. J. (2008). A role for dopamine in temporal decision making and reward maximization in Parkinsonism. Journal of Neuroscience, 28(47), 12294-12304.
86. Nader, M. A., Czoty, P. W., Gould, R. W., & Riddick, N. V. (2008). Positron emission tomography imaging studies of dopamine receptors in primate models of addiction. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 363(1507), 3223-3232.
87. Nader, M. A., Daunais, J. B., Moore, T., Nader, S. H., Moore, R. J., Smith, H. R., et al. (2002). Effects of cocaine self-administration on striatal dopamine systems in rhesus monkeys: Initial and chronic exposure. Neuropsychopharmacology, 27(1), 35-46.
88. Nader, M. A., Morgan, D., Gage, H. D., Nader, S. H., Calhoun, T. L., Buchheimer, N., et al. (2006). PET imaging of dopamine D2 receptors during chronic cocaine self-administration in monkeys. Nature Neuroscience, 9(8), 1050-1056.
89. Nelson, A., & Killcross, S. (2006). Amphetamine exposure enhances habit formation. J. Neurosci., 26(14), 3805-3812.
90. Nicola, S. M. (2007). The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology, 191(3), 521-550.
91. Noble, E. P. (2003). D2 dopamine receptor gene in psychiatric and neurologic disorders and its phenotypes. American Journal of Medical Genetics, Part B, Neuropsychiatric Genetics, 116B(1), 103-125.
92. O'Brien,C. P., Ehrman, R.,&Ternes, J. (1986). Classical conditioning in human opioid dependence. In S. R. Goldberg and I. P. Stolerman (Eds.), Behavioral Analysis of Drug Dependence (pp. 329-356). London: Academic Press.
93. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304(5669), 452-454.
94. Olson, V. G., Zabetian, C. P., Bolanos, C. A., Edwards, S., Barrot, M., Eisch, A. J., et al. (2005). Regulation of drug reward by cAMP response element-binding protein: Evidence for two functionally distinct subregions of the ventral tegmental area. J. Neurosci., 25(23), 5553-5562.
95. Packard, M. G., & Knowlton, B. J. (2002). Learning and memory functions of the basal ganglia. Annual Review of Neuroscience, 25, 563-593.
96. Pasquereau, B.,Nadjar, A., Arkadir, D., Bezard, E., Goillandeau, M., Bioulac, B., et al. (2007). Shaping of motor responses by incentive values through the basal ganglia. Journal of Neuroscience, 27(5), 1176-1183.
97. Peterson, D. A., Elliott, C., Song, D. D., Makeig, S., Sejnowski, T. J., & Poizner, H. (2009). Probabilistic reversal learning is impaired in Parkinson's disease. Neuroscience, 163(4), 1092-1101.
98. Pezze, M., Dalley, J. W., & Robbins, T. W. (2007). Differential roles of dopamine D1 and D2 receptors in the nucleus accumbens in attentional performance on the five-choice serial reaction time task. Neuropsychopharmacology, 32(2), 273-283.
99. Piazza, P. V., Demini'ere, J., Le Moal, M., & Simon, H. (1989). Factors that predict individual vulnerability to amphetamine self-administration. Science, 245(4925), 1511-1513.
100. Porrino, L. J., Daunais, J. B., Smith, H. R.,&Nader, M. A. (2004). The expanding effects of cocaine: Studies in a nonhuman primate model of cocaine self-administration. Neuroscience and Biobehavioral Reviews, 27(8), 813-820.
101. Porrino, L. J., Lyons, D., Smith, H. R., Daunais, J. B., & Nader, M. A. (2004). Cocaine self-administration produces a progressive involvement of limbic, association, and sensorimotor striatal domains. J. Neurosci., 24(14), 3554-3562.
102. Potenza, M. N. (2008). The neurobiology of pathological gambling and drug addiction: An overview and new findings. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 363(1507), 3181-3189.
103. Redish, A. D. (2004). Addiction as a computational process gone awry. Science, 306(5703), 1944-1947.
104. Redish, A. D., Jensen, S., & Johnson, A. (2008). A unified framework for addiction: Vulnerabilities in the decision process. Behavioral and Brain Sciences, 31(4), 415-437.
105. Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling. Psychological Review, 114(3), 784-805.
106. Redish,A.D.,&Johnson,A. (2007).Acomputational model of craving and obsession. Annals of the New York Academy of Sciences, 1104, 324-339.
107. Robinson, T. E., & Berridge, K. C. (1993). The neural basis of drug craving: An incentive-sensitization theory of addiction. Brain Research, 18(3), 247-291.
108. Rodd, Z. A., Bell, R. L., Zhang, Y., Murphy, J. M., Goldstein, A., Zaffaroni, A., et al. (2005). Regional heterogeneity for the intracranial self-administration of ethanol and acetaldehyde within the ventral tegmental area of alcohol-preferring (P) rats: Involvement of dopamine and serotonin. Neuropsychopharmacology, 30(2), 330-338.
109. Rodd, Z. A., Melendez, R. I., Bell, R. L., Kuc, K. A., Zhang, Y., Murphy, J. M., et al. (2004). Intracranial self-administration of ethanol within the ventral tegmental area of male wistar rats: Evidence for involvement of dopamine neurons. J. Neurosci., 24(5), 1050-1057.
110. Rodd-Henricks, Z. A., McKinzie, D. L., Li, T., Murphy, J. M., & McBride, W. J. (2002). Cocaine is self-administered into the shell but not the core of the nucleus accumbens of Wistar rats. Journal of Pharmacology and Experimental Therapeutics, 303(3), 1216-1226.
111. Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nature Neuroscience, 10(12), 1615-1624.
112. Roesch, M. R., Singh, T., Brown, P. L., Mullins, S. E., & Schoenbaum, G. (2009). Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. Journal of Neuroscience, 29(42), 13365-13376.
113. Roesch, M. R., Takahashi, Y., Gugsa, N., Bissonette, G. B., & Schoenbaum, G. (2007). Previous cocaine exposure makes rats hypersensitive to both delay and reward magnitude. Journal of Neuroscience, 27(1), 245-250.
114. Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005). Representation of actionspecific reward values in the striatum. Science, 310(5752), 1337-1340.
115. Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009). A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews Neuroscience, 10(12), 885-892.
116. Schoenbaum, G., Saddoris, M. P., Ramus, S. J., Shaham, Y., & Setlow, B. (2004). Cocaine-experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions. European Journal of Neuroscience, 19(7), 1997-2002.
117. Schoenbaum, G., & Setlow, B. (2005). Cocaine makes actions insensitive to outcomes but not extinction: Implications for altered orbitofrontal-amygdalar function. Cerebral Cortex, 15(8), 1162-1169.
118. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593-1599.
119. Self, D. W. (2004). Regulation of drug-taking and -seeking behaviors by neuroadaptations in the mesolimbic dopamine system. Neuropharmacology, 47 (Suppl. 1), 242-255.
120. Sellings, L. H. L., & Clarke, P. B. S. (2003). Segregation of amphetamine reward and locomotor stimulation between nucleus accumbens medial shell and core. J. Neurosci., 23(15), 6295-6303.
121. Sellings, L. H. L., McQuade, L. E., & Clarke, P. B. S. (2006a). Evidence for multiple sites within rat ventral striatum mediating cocaine-conditioned place preference and locomotor activation. Journal of Pharmacology and Experimental Therapeutics, 317(3), 1178-1187.
122. Sellings, L. H. L., McQuade, L. E., & Clarke, P. B. S. (2006b). Characterization of dopamine-dependent rewarding and locomotor stimulant effects of intravenously-administered methylphenidate in rats. Neuroscience, 141(3), 1457-1468.
123. Shin, R., Qin, M., Liu, Z., & Ikemoto, S. (2008). Intracranial self-administration of MDMA into the ventral striatum of the rat: Differential roles of the nucleus accumbens shell, core, and olfactory tubercle. Psychopharmacology, 198(2), 261-270.
124. Spina, L., Fenu, S.,Longoni,R., Rivas, E.,&Di Chiara,G. (2006).Nicotine-conditioned single-trial place preference: Selective role of nucleus accumbens shell dopamine D1 receptors in acquisition. Psychopharmacology, 184(3-4), 447-455.
125. Steeves, T. D. L., Miyasaki, J., Zurowski,M., Lang, A. E., Pellecchia, G., Van Eimeren, et al. (2009). Increased striatal dopamine release in Parkinsonian patients with pathological gambling: a [11C] raclopride PET study. Brain, 132(Pt. 5), 1376-1385.
126. Sutton,R. S.,&Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
127. Taha, S. A., & Fields, H. L. (2005). Encoding of palatability and appetitive behaviors by distinct neuronal populations in the nucleus accumbens. Journal of Neuroscience, 25(5), 1193-1202.
128. Takahashi, Y., Roesch, M. R., Stalnaker, T. A., & Schoenbaum, G. (2007). Cocaine exposure shifts the balance of associative encoding from ventral to dorsolateral striatum. Frontiers in Integrative Neuroscience, 1, 11.
129. Takahashi, Y., Schoenbaum, G., & Niv, Y. (2008). Silencing the critics: Understanding the effects of cocaine sensitization on dorsolateral and ventral striatum in the context of an actor/critic model. Frontiers in Neuroscience, 2(1), 86-99.
130. Thanos, P. K., Volkow, N. D., Freimuth, P., Umegaki, H., Ikari, H., Roth, G., et al. (2001). Overexpression of dopamine D2 receptors reduces alcohol selfadministration. Journal of Neurochemistry, 78(5), 1094-1103.
131. van der Meer, M. A. A., & Redish, A. D. (2009). Covert expectation-of-reward in rat ventral striatum at decision points. Frontiers in Integrative Neuroscience, 3, 1.
132. Vanderschuren, L. J. M. J., Di Ciano, P., & Everitt, B. J. (2005). Involvement of the dorsal striatum in cue-controlled cocaine seeking. Journal of Neuroscience, 25(38), 8665-8670.
133. Vanderschuren, L. J. M. J., & Everitt, B. J. (2004). Drug seeking becomes compulsive after prolonged cocaine self-administration. Science, 305(5686), 1017-1019.
134. Volkow, N. D., Fowler, J. S., Wang, G., & Swanson, J. M. (2004). Dopamine in drug abuse and addiction: Results from imaging studies and treatment implications. Molecular Psychiatry, 9(6), 557-569.
135. Volkow, N. D., Wang, G., Begleiter, H., Porjesz, B., Fowler, J. S., Telang, F., et al. (2006). High levels of dopamine D2 receptors in unaffected members of alcoholic families: Possible protective factors. Archives of General Psychiatry, 63(9), 999-1008.
136. Volkow, N. D., Wang, G., Fowler, J. S., Logan, J., Gatley, S. J., Gifford, A., et al. (1999). Prediction of reinforcing responses to psychostimulants in humans by brain dopamine D2 receptor levels. American Journal of Psychiatry, 156(9), 1440-1443.
137. Volkow, N. D., Wang, G., Fowler, J. S., & Telang, F. (2008). Overlapping neuronal circuits in addiction and obesity: Evidence of systems pathology. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 363(1507), 3191-3200.
138. Volkow, N. D.,Wang, G., Telang, F., Fowler, J. S., Logan, J., Childress, A., et al. (2006). Cocaine cues and dopamine in dorsal striatum: Mechanism of craving in cocaine addiction. Journal of Neuroscience, 26(24), 6583-6588.
139. Volkow, N. D., & Wise, R. A. (2005). How can drug addiction help us understand obesity? Nature Neuroscience, 8(5), 555-560.
140. Wong, D. F., Kuwabara, H., Schretlen, D. J., Bonson, K. R., Zhou, Y., Nandi, A., et al. (2006). Increased occupancy of dopamine receptors in human striatum during cue-elicited cocaine craving. Neuropsychopharmacology, 31(12), 2716-2727.
141. Zangen,A., Ikemoto, S.,Zadina, J. E.,&Wise,R.A. (2002).Rewarding and psychomotor stimulant effects of endomorphin-1: Anteroposterior differences within the ventral tegmental area and lack of effect in nucleus accumbens. J. Neurosci., 22(16), 7225-7233.
142. Zangen, A., Solinas,M., Ikemoto, S., Goldberg, S. R., &Wise, R. A. (2006). Two brain sites for cannabinoid reward. Journal of Neuroscience, 26(18), 4901-4907.
143. Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009). A neural computational model of incentive Salience. PLoS Computational Biology, 5(7), e1000437.